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Preface 


The aim of the book 

The aim of this book is to give the necessary knowledge about the implementa¬ 
tion of MATLAB® and Simulink® in the development of embedded control systems. 
Together, MATLAB and Simulink present a sophisticated programing environment 
which may be used for the design as well as for the implementation of embedded 
control systems. In this book, the authors exploit the opportunity to generate auto¬ 
matically and embed control code from Simulink models which allows to develop 
quickly efficient and error free code. The automated code generation and the availabil¬ 
ity of powerful processors make possible the implementation of complex high-order 
controllers which achieve fast and high-performance closed-loop dynamics. 

The book is oriented toward the application of modem Control Theory to the 
development of high-performance control laws which ensure good dynamics and 
robustness of the closed-loop system to plant uncertainties. The theoretical develop¬ 
ments are reduced to the possible minimum the accent being put on the application 
issues. The basic results of Control Theory are given without proofs, and for more 
information, the reader is advised to consult the notes and references given at the end 
of the corresponding chapter. The presentation contains lots of nontrivial examples, 
which allow to illustrate the practical implementation of theoretical results. Most of 
the examples are taken from the area of motion control, but the book may also be 
used by designers in other areas. 

The book covers mainly the design of linear controllers which are most frequently 
used in practice. This approach is justified by the principle of linearity of small 
increments which states that almost any natural process is linear in small amounts 
almost everywhere. Fortunately, as noted by Kostrikin and Manin [1], the small 
neighborhood in which this principle is valid is sufficiently large. 

An important part of the book is the freely downloadable material which contains 
MATLAB and Simulink files for all examples presented in the corresponding chap¬ 
ters. The usage of this material can help in understanding the different issues arising 
in the analysis and design of embedded control systems. 


Expected audience 

The book is intended as a reference source for MSc and PhD students who study 
in the field of Control Engineering as well as for control engineers working in the 
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industry. It can also be used as a reference for researchers in Control Engineering 
who are interested in the implementation of MATLAB and Simulink in the design of 
Control Systems. The first four chapters may also be used for a masters course on the 
design of embedded control systems. 


The contents 

The book consists of seven chapters and six appendices. 

Chapter 1 presents a brief overview of the embedded control systems and the 
corresponding design process. 

In Chapter 2, we describe several fundamental issues related to the development of 
plant model, like linearization, discretization, stochastic modeling, and identification. 
This chapter contains also a section on uncertainty modeling. 

Chapter 3 is entirely devoted to the performance requirements and design limita¬ 
tions arising in embedded controller design. A significant part of this chapter are the 
sections on robust stability and robust performance analysis of uncertain systems. 

In Chapter 4, we present in detail the design of five basic controllers used in the 
modern Control Theory: proportional-integral-derivative (PID) controllers, linear- 
quadratic-Gaussian (LQG) controllers, and linear-quadratic (LQ) regulators with 
filters, Mf, and fi controllers. For comparison purposes, all controllers are imple¬ 
mented on the same plant which represents the well-known cart-pendulum system. 
We consider the possible difficulties in the design of these controllers and give a com¬ 
parison of the properties of corresponding closed-loop systems. These properties are 
illustrated by the hardware-in-the-loop (HIL) simulation of the closed-loop systems 
for the worst combination of plant parameters values. 

In the last three chapters, we present three case studies which describe in detail 
the theoretical and practical issues arising in the design of three embedded control 
systems. 

In Chapter 5, we consider the design of a low-cost control system for a two-tank 
plant. This chapter should be of interest to the readers who want to use low-cost 
processors in the design of embedded systems. 

Chapter 6 is devoted to the robust control of a miniature helicopter. We consider 
the implementation of high-order controller which ensures robust performance of the 
closed-loop system in the presence of severe wind disturbances. 

Finally, in Chapter 7, we present the design of embedded control system of a 
two-wheeled robot. In this case, we demonstrate experimentally the implementation 
of 30th-order controller which ensures robust stability and performance of the closed- 
loop system in the presence of plant uncertainty. 

In Appendices A-D, we give some necessary facts from matrix analysis, linear 
system theory, stochastic processes, and identification of linear models, respec¬ 
tively. In Appendices E and F, we discuss important practical issues like connection 
between sensors and DSP and measurement of angular velocities by Hall encoders, 
respectively. 
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Chapter 1 

Embedded control systems 


In this chapter, we make a concise overview of embedded control systems and dis¬ 
cuss some aspects of the corresponding hardware and software which is used in these 
systems. The embedded control systems are digital systems and their performance is 
affected by sampling and quantization errors. That is why, we present some basic 
elements of fixed-point and floating-point computations and describe the round¬ 
ing errors associated with these computations. In case of fixed-point arithmetic, 
the emphasis is put on the scaling problem, which is the most important issue in 
using such arithmetic. We describe briefly the stages of embedded controller design, 
controller simulation, and implementation. 


1.1 Introduction 

According to a popular definition, every electrical or mechanical system that contains 
a controller, implemented on the base of digital processor, is called embedded system. 
The embedded control systems are systems in which are implemented algorithms for 
real-time control using feedback. The embedded control systems represent synthesis 
between modem digital technologies and control theory methods. It is necessary 
to distinguish between general purpose computational devices (computers) and the 
embedded system processors. The computers may execute a great number of programs 
with different purpose which are used to solve computational problems. On the other 
hand, the embedded system processor, which may be very powerful, performs only a 
special control program. Also, the embedded system controller may contain additional 
hardware which distinguishes it from the general purpose computer. Most of the 
contemporary embedded systems are implemented on the basis of microcontrollers— 
computational devices whose functional blocks (central processor, memory, input and 
output devices, and interface buses) are combined on a single chip. From hardware 
point of view, the microcontrollers represent a very-large-scale integration (VLSI) 
circuits. 

To work successfully in real time, the embedded system should be developed so 
that the required computational cycle fits in the given time interval. For this aim, it is 
necessary to choose processor with appropriate computational efficiency, to develop 
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fast control algorithm and to create interface schemes with minimum possible delay 
of signal transmission. On the second place, the embedded control system should 
possess stability in respect to external data. If, for instance, the data, necessary to 
obtain the result, do not arrive in time, then the system cannot produce the required 
result in time. In such a case, the system should not lock, but has to continue to give 
appropriate result in real time. 

The process of developing embedded control systems has strongly multidisci¬ 
plinary character, since it is required to perform a system integration of problems, 
associated with 

- derivation of mathematical models of physical plants, sensors, communication 
hardware, and so on, 

- development of methods for high performance control, 

- embedding of control algorithms in different hardware and software platforms, 

- carrying out communication with remote plants, 

- solving problems associated with power supply. 

The theoretical foundation of the embedded control systems is the theory of 
hybrid systems. The hybrid systems combine continuous processes described by dif¬ 
ferential or difference equations and discrete-event processes, described by finite 
automata. Such systems arise in a natural way in the control of continuous processes 
by the aid of digital devices and their investigation require a synthesis of control 
theory and computer science. The usage of complicated robust and adaptive control 
laws leads to the necessity of developing embedded system which work under the 
conditions of restricted processor accuracy and relatively small sampling interval. 
This represents a serious challenge both from theoretical and practical point of 
view. 


1.2 Structure and elements of embedded control systems 

1.2.1 Typical block diagram 

From control theory point of view, the embedded control system for a continuous¬ 
time plant represents a closed-loop multivariable digital control system with a block 
diagram, shown in Figure 1.1. Very few plants encountered in practice are inherently 
digital, so we assume that generally the plant is continuous-time. Such systems are 
called sampled-data systems. 

The aim of the control system is to ensure desired behavior of controlled plant 
outputs in accordance with the reference signals in presence of unknown distur¬ 
bances and noises in the closed loop. In the general case, the plant has m analog 
control inputs produced by actuators and r analog outputs measured by the respective 
sensors. The measurements are corrupted by noises which, along with the plant distur¬ 
bances, may significantly affect the closed-loop system behavior. The analog sensor 
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Noises 

Figure 1.1 Block diagram of an embedded control system 


signals are sampled with sampling period T s by an impulse sampler, which produces 
digital representations yfk), y 2 (k), y r (k ) of the measured signals, where yfk) 

means the value of yft) for t = kT s , k = 1,2,.... The sampler is a device, driven 
hy the system clock, that is converting a continuous-time signal into a sequence of 
numbers. Normally, the sampler is combined into analog-to-digital (A/D) converter, 
which also quantizes the sequence of numbers into a finite precision number. (Note 
that the impulse sampler by itself does not have any physical meaning.) The digital 
measurement signals are used by the controller algorithms, embedded in the digi¬ 
tal computer, to produce the digital control signals u\(k), ufk.), ..., u m (k). These 
signals are converted to the corresponding actuator inputs u\(t), uiit ),..., u m (t) by 
using digital-to-analog (D/A) converters. The purpose of the D/A converters is to pro¬ 
duce analog approximations of the digital signals using appropriate reconstruction 
algorithms. The analog signals uft), u 2 (t),u m (t) are determined by hold devices 
during the sample period until the next sample arrives and the process of holding 
each of the samples is termed sample and hold (S/H). The analog signals u/t) are 
used as actuator inputs to control the plant behavior. The work of the A/D and D/A 
converters is synchronized by the system clock with the work of the digital computer. 
Note that the block diagram may contain additional elements like antialiasing filters 
whose function is described in the next section. Also, it is possible that the outputs 
of the analog sensors are sampled at different periods and the system may have many 
controllers with different sampling periods. In the cases where the sensors have digital 
outputs or/and the actuators have digital inputs, the block diagram shown in Figure 1.1 
may still be valid taking into account that the A/D and D/A conversion is performed 
inside the corresponding devices. 
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Figure 1.2 Operation of the zero-order hold (ZOH) 




Figure 1.3 Operation of the analog-to-digital converter and digital-to-analog 
converter with zero-order hold 


1.2.2 A/D and D/A conversion 

In the simplest case, which is assumed in this book, the sample and hold process 
reduces to a zero-order hold (ZOH) whose operation is illustrated in Figure 1.2. The 
digital code of the signal at the sampling instant is converted into analog signal with 
magnitude corresponding to the value of the digital signal and duration, equal to the 
sampling period T s . The frequency (o s = 2tv/T s is called sampling frequency. The 
zero-order hold keeps constant the magnitude of the analog signal between two 
sampling instants. 

The operation of A/D converter and D/A converter in case of using zero-order 
hold is illustrated in Figure 1.3. Commonly using a process of successive approxima¬ 
tion, the A/D conversion (ADC) maps the analog input signal to a digital output. This 
digital value is composed of a set of binary values called bits (often represented by 
Os and Is). The set of bits represents a decimal or hexadecimal number that can be 
used by the microcontroller. The D/A converter transforms the digital code to signal 
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samples and then converts the binary-coded digital signal to analog signal. It is seen 
that the D/A conversion with zero-order hold produces a staircase signal from the 
samples sequence. 

The A/D converter has two functions: 

1. Sampling of the analog signal: the continuous-time signal is replaced by a 
sequence of values equally spaced in the time. These values correspond to the 
amplitude of the continuous-time signal at sampling instants. 

2. Quantization: the signal amplitude is approximated by a finite precision num¬ 
ber coded with a binary sequence. Typically, the A/D converter has 8-24 bits 
resolution giving 2 8 -2 24 levels of quantization. 

A drawback of the zero-order hold is that the output of the hold device is dis¬ 
continuous. The discontinuities can excite poorly damped mechanical modes of the 
physical process and also cause wear in the actuators of the system. That is why in 
some cases, a more sophisticated hold device is used by allowing the continuous-time 
signal to be a higher order polynomial between the sampling points. Using a first- 
order hold the signal between the sampling points is obtained by a linear interpolation 
which leads to better reconstruction of the sampled signal. 


1.2.3 Sensors 

Sensor is a device that when exposed to a physical phenomenon (displacement, force, 
temperature, pressure, etc.) produces a proportional output signal (electrical, mechan¬ 
ical, magnetic, etc.). The term transducer is often used synonymously with sensors. 
However, ideally, a sensor is a device that responds to a change in the physical 
phenomenon. On the other hand, a transducer is a device that converts one form 
of energy into another form of energy. The new generation sensors involve smart 
material sensors, microsensors, and nanosensors. 

Sensors can be classified as passive or active. In passive sensors, the power 
required to produce the output is provided by the sensed physical phenomenon 
itself (such as a thermometer), whereas the active sensors require external power 
source (such as a gyroscope). Furthermore, sensors are classified as analog or dig¬ 
ital on the basis of the type of output signal. Analog sensors produce continuous 
signals that are proportional to the sensed parameter and typically require ADC 
before feeding to the digital controller. Digital sensors on the other hand produce 
digital outputs that can be directly interfaced with the digital controller. Often, 
the digital outputs are produced by adding an A/D converter to the sensing unit. 
If many sensors are required, it is more economical to choose simple analog sen¬ 
sors and interface them to the digital controller equipped with a multichannel A/D 
converter. 
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A number of static and dynamic factors must be considered in selecting a suitable 
sensor to measure the desired physical parameter. The following list involves the 
typical factors [2, Chapter 17]: 


Range 

Resolution 

Accuracy 

Precision 
Sensitivity 
Zero offset 
Linearity 

Zero drift 

Response time 

Bandwidth 

Resonance 

Operating temperature 
Deadband 
Signal-to-noise ratio 


Difference between the maximum and minimum value 
of the sensed parameter 

The smallest change the sensor can differentiate 
Difference between the measured value and the 
true value 

Ability to reproduce repeatedly with a given accuracy 
Ratio of change in output to a unit change of the input 
A nonzero value output for no input 
Percentage of deviation from the best-fit linear 
calibration curve 

The departure of output from zero value over a period 
of time for no input 

The time lag between the input and output 
Frequency at which the output magnitude drops by 3 dB 
The frequency at which the output magnitude peak 
occurs 

The range in which the sensor performs as specified 
The range of input for which there is no output 
Ratio between the magnitudes of the signal and 
the noise at the output 


Models of sensors, appropriate for usage in embedded control system design, are 
described in Section 2.7. 

1.2.4 Actuators 

The purpose of actuators is to control a physical device or affect the physical environ¬ 
ment. The three commonly used actuators are solenoids, motors, and servos. Solenoids 
are devices containing a movable iron core that is activated by a current flow. The 
movement of this core can then control some form of hydraulic or pneumatic flow. 
The next type of actuator is the electric motors. There are three main types: direct 
current (DC), alternating current (AC), and stepper motors. DC motors may be con¬ 
trolled by a fixed DC voltage or by pulse width modulation (PWM). In a PWM signal, 
such as shown in Figure 1.4, a voltage is alternately turned on and off while changing 
(modulating) the width of the on-time signal, or duty cycle. AC motors are generally 
cheaper than DC motors, but require variable frequency drive to control the rotational 
speed. Stepper motors move by rotating a certain number of degrees in response to 
an input pulse. Servos are DC motors with encapsulated electronics, built in gear and 
feedback for PWM control. The servos should perform fast changes in the position, 
velocity and acceleration. Most servo can rotate up to 90° or 180°, but some may 
perform a full revolution. The servos cannot rotate permanently in one direction, i.e., 
they cannot be used to actuate wheels, but they are precise in positioning and are 
convenient in control of mobile robots, drones, and so on. 
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Figure 1.4 Pulse width modulation 


1.2.5 Processors 

For the purpose of embedded control systems, one of the following processor 
technology is frequently used. 

Programmable logical controller (PLC)—The programmable logical controller 
is a specialized industrial controller. PLC is a device working in a real time: the 
inputs from switches and sensors are processed on the basis of a logical program 
and the output controller states change to steer machine or process. PLC may work 
under heavy operating conditions (dust, electrical interferences, vibration, and shock). 
These controllers can be used to implement sufficiently complicated control laws. 

Microcontroller unit (MCU)—In essence, this is a small computer which con¬ 
stitutes of processor, memory, and periphery on a single chip. The components of 
most MCU are: processor, buses (address bus, data bus, and control bus), inter¬ 
ruption controller, DMA (direct memory access) controller, ROM memory, RAM 
memory, timers, inputs, and outputs. Usually, MCU have ADC, digital outputs, digi¬ 
tal inputs, PWM outputs. Due to the comparatively low microcontroller prices, they 
are widely used in mass production. 

Some of the popular microcontrollers are from the PIC (programmable intelli¬ 
gent computer or peripheral interface controller) family. These are general purpose 
microcontrollers with affordable price which have applications in robotics, servo- 
controllers, and so on. Other microprocessors from this family include Parallax SX 
and the series Holtek HT48FxxE. Widely used are also microcontrollers from ARM 
(advanced RISC machines) family, which are based on the 32-bit architecture of 
RISC processors. This family keeps up the market part of about 75 percent of all 
32-bit processors and almost 90 percent of all embedded processors. Examples of 
ARM-processors are Intel X-Scale, the family Philips LPC2000, Atmel AT91SAM7, 
ST Microelectronics STR710, and the series Freescale MCIMX27. 
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Digital signal processor (DSP)—It is designed for specialized applications like 
matrix operations, real-time filtration, sound and image processing, and so on. In 
essence, the DSPs are microcontrollers (they have ROM memory, RAM memory, 
serial and parallel interfaces, DMA controller, timers, controllers for interrupt pro¬ 
cessing and digital and analog periphery in some cases). For real-time control, the 
32-bit controllers of Texas Instruments series C-2000: Delfino, Piccolo, InstaSPIN 
and F28M3x are used. The highest speed have the microcontrollers from Delfino fam¬ 
ily, which may be used to implement complex control laws. These microcontrollers 
have coprocessors, which are used to perform floating point computations. 

Field programmable gate arrays (FPGA)—Integrated circuits, whose structure 
usually represents a two-dimensional array of logical blocks, buses for interconnection 
between them, auxiliary memory blocks and functional blocks (for instance, multi¬ 
pliers). The functions of these circuits are post determined by programing (electrical 
configuration). FPGA can perform parallel computations (MCU and DSP cannot). 
In practice, some of the fastest DSPs are built on FPGA chips. Also, there are ready 
processor kernels, which are programed on FPGA chips, on which it is possible to set 
very high clock frequency, i.e., their performance increases. The desired functionality 
of FPGA can be configured after the device is produced, installed in a product and 
even in some cases after the product is supplied to the user. This makes the FPGA a 
device, which is fundamentally different from the other devices on integrated circuits. 

More details about the architecture and operation of microcontrollers and FPGA 
are given in Section 1.8. 

1.2.6 Software 

Practical implementation of control algorithm is not a trivial problem. Target hardware 
platform which executes the control calculation enriches with numerous dynamical 
effects the original plant. Such effects are time sampling, quantization, sample time 
variation, information transport delays, real numbers formatting, and rounding. These 
effects have to be accounted in plant modeling if not as controllable dynamics at 
least as uncertainty. Nowadays, there are many software components with open or 
closed source code, which accelerate programing process. Therefore, software design 
issues are left mainly in system configuration and compatibility between software and 
hardware components. 

There are several ways for embedded programing. Formal languages are ubiq¬ 
uitous tool for programing. Expressions from such languages are derived from 
certain formal grammar and have tree like structure. To accelerate further system 
development, there are many visual languages too. 

Ultimately, the goal of control engineer is to program the formula of his control 
algorithm into the hardware platform in order to start its autonomous execution. This 
goal requires securing of the following software components: 

• Periodic task execution —Usually, a hardware timer is programed to generate an 
interrupt signal periodically. Then timer interrupt routine calls step function of 
control algorithm to update its internal state and output according to elapsed time. 
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Arithmetic support —Target hardware arithmetic capabilities have to be consid¬ 
ered when developing control calculation. For example, if the target does not 
have native support for floating-point numbers, some software libraries for such 
support can be included. 

Input data drivers —Heterogeneous nature of sensors requires several layers of 
driver programs to process their signals to enable control algorithm to access 
them. For digital sensors, the programmer should install software components 
for communication busses and related protocols. Analog sensors require some 
ADC configuration software. 

Output data drivers —In software, the control signal is a number which have to be 
transferred to an actuator device in order to take its effect. Usually, this is related 
to driver installation for D/C or PWM peripherals. Sometimes, the control signal 
is transmitted over digital communication to a smart actuator device. 

External communication —Since control system development is iterative process 
designer needs a continuous feedback about internal state of control algorithm and 
sensor measurements. To achieve this, the programmer should install some high¬ 
speed communication (USB, RS232, Ethernet) software component to transmit 
data to an operator workstation. 


1.2.6.1 Operational systems 

The real-time operational systems (RTOS) are designed to control real-time appli¬ 
cations. This means control under specified time restrictions, i.e., strictly specified 
time limits for control system reaction. The RTOS classification, depending on the 
importance of the timely response, defines two types RTOS—with hard real time and 
with soft real time. The difference between these two types lies in that in the hard 
real-time the delay of control reaction will be fatal for the whole system. In the other 
case—control with soft real time—the delay after the specified period will lead in 
the worst case to system performance degradation, but effect is not irreparable. In 
the case of single-task systems, the usage of RTOS is not indispensable. The opera¬ 
tional system is necessary when the embedded control system should perform several 
complex tasks or to connect it to other devices. The most frequently used RTOS are 
the Linux-based systems RTLinux and UTLinux, QNX, VxWorks, FreeRTOS, and 
others. Embedded RTOS provide limited user interface compared to conventional OS. 

Technically the OS is a collection of interacting modules invoked by a central 
program (the kernel). All information in the kernel is represented as objects encapsu¬ 
lating data and allowed operations on that data. Most common OS objects are tasks, 
mutexes, semaphores, timers, events, message queues, mailboxes, and files. Usually 
there is a separation in OS between kernel and user program scope. User programs (or 
applications) have limited access to kernel objects in an effort to guarantee stability 
of the system. User programs use dedicated API (application programing interface) 
to access hardware platform devices which are highly abstracted. For example, the 
file object represents a communication device and sending data through that device 
is equivalent to write that data to the corresponding file object. 
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1.2.6.2 Protocols 

Communication in digital systems synchronize the data across the system—between 
processor, memory, sensors, and other peripherals. Information channel can be any 
physical media connecting communication parties. Communication process can be 
of various complexity so it is organized as a hierarchy of protocols. Protocol is a set 
of rules and recipes for data processing in order to achieve some quality of service 
(QoS). 

The communication between the processor, sensors, and actuators is realized by 
the aid of different protocols like RS232 (Recommended Standard 232), I 2 C (two- 
wire serial bus), CAN (controller area network) and SPI (serial peripheral interface). 
For wireless connection between the embedded system and other devices in local 
network, are used protocols like WLAN (wireless local area network), Bluetooth, 
ZigBee, and others. 


1.3 Sampling and aliasing 

MATLAB® file used in this section 
File Description 

sampling_aliasing Aliasing illustration 


Is any information lost when sampling a continuous-time signal? The answer of 
this question is given by the Kotelnikov-Shannon sampling theorem which states that 
if the signal contains no frequencies above w o, then the continuous-time signal can be 
uniquely reconstructed from a periodically sampled sequence provided the sampling 
frequency co s is higher than 2 ojq . The frequency &>v = op/2 = n/T s plays an important 
role in the analysis of sampled systems and is called the Nyquist frequency. A signal 
whose frequency is above the Nyquist frequency cannot be reconstructed after the 
sampling. 


Example 1.1. Aliasing 

Consider the signal 

y(t) = 4 sin (2nt) + sin (20 nt + n/6). 

If the sampling period T s is chosen equal to 0.1 s then 
y(kT s ) = 4 sin (0.2kn) + sin (2kn + n/6) 

= 4sin(0.2A:rr) + 0.5 

In this way, as a result of the sampling, the high-frequency component sin (20jrt + 
n/6) has been shifted to the constant 0.5, i.e., the high frequency component appears 
as a signal of low frequency (in the given case zero). This phenomenon is called 
aliasing or frequency folding. 
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Time (s) 

Figure 1.5 Aliasing effect for low sampling rate 


The result of sampling is shown in Figure 1.5. It is seen that the sampled high 
frequency component appears as a constant upward shift of the low frequency com¬ 
ponent. In the given case, the signal contains frequency co 0 = 207r rad/s and since 
the sampling frequency is co s = 2rc /0.1 = <w 0 , the condition imposed by the sampling 
theorem is not fulfilled (coo > = 107r). □ 

Due to the aliasing effect, it is necessary to choose the sampling frequency such 
that co N > aw, where <w max is the maximum frequency of the signal which should be 
sampled. If the required sampling frequency is very high and cannot be implemented, 
then one has to remove all frequencies above the Nyquist frequency before sampling 
the signal. This may be done by using antialiasing filters which are analog filters 
whose bandwidth must be such that the attenuation above the Nyquist frequency is 
sufficiently high. It is stated in [3] that Bessel filters of orders 2-6 are in practice 
sufficient to eliminate most of the influence of higher frequencies. A second-order 
Bessel filter with bandwidth co B has the transfer function 


C s/cob f + 2 ^co(s/co B ) + of 

with co—1.21 and f = 0.87. The Bessel filters has the property that they can be well 
approximated by a time delay. This is an advantage in the design of the controller 
since the dynamics of the antialiasing filter has to be included in the design of the 
sampled-data controller. 

A more elaborated technique to avoid aliasing, suitable to the case of very low 
frequency sampling, is described in [4, Chapter 2], 
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1.4 Fixed-point arithmetic 

MATLAB file used in this section 


File Description 


gyro_slop_bias Compute the slop and bias 
for a 14-bit gyro signal 


Binary numbers are represented as either fixed-point or floating-point data types. 

1.4.1 Fixed-point numbers 

An n-bit binary word can represent integers between 0 and 2" — 1. Conversely, all the 
integers in this range can be represented by an n-bit binary word. This interpretation 
of binary words is called unsigned integer representation, because each word corre¬ 
sponds to a positive (or unsigned) integer. The drawback of the unsigned integers is 
that they can be used only in the case of positive integers. 

A more general data type is the fixed-point representation. A fixed-point data 
type is characterized by the word length in bits, the position of the binary point, and 
whether it is signed or unsigned. The position of the binary point is the means by 
which fixed-point values are scaled and interpreted. 

A binary representation of a generalized fixed-point number (either signed or 
unsigned) is shown in Figure 1.6 where the bit b, is the ith binary digit. The fixed-point 
number is represented as 

( b n -1 ...b m »b m -1 ...b 0 )2 

integer part fractional part 

where the number n is the word length in bits, k — n — m is the integer part length and 
m is the fractional part length. The subscript 2 indicates the radix used. The integer part 
of the number, b n -\b n -2... b m is separated from the fractional part b m -\b m -2 ... bo by 
the binary point or radix point. The bit b„_i is termed the most significant, or highest, 
bit (MSB) and b 0 is termed the least significant, or lowest, bit (LSB). The fixed-point 
number has the decimal value 

N =J2 bpj~ m = b n -\2 n ~ l + b n - 2 2"“ 2 + • ■ ■ + b m+] 2' + b m 2° 

+ b m _i2 -1 + ■ ■ • + bi2 -m+1 + bfl~ m (1.1) 



Binary point 


Figure 1.6 Fixed-point number 
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As an example, consider the fixed-point number 1011.011 which has word length 
n = 7 and fractional part length m = 3. It has the decimal value 

1011.011 = 1(2 3 ) + 0(2 2 ) + 1(2') + 1(2°) + 0(2-') + 1(2“ 2 ) + 1(2“ 3 ) 

= 11.375. 

Particular case of the fixed-point numbers are the integer numbers for which 
m = 0 . 

Fixed-point data types can be either signed or unsigned. Signed binary fixed-point 
numbers are typically represented in one of the following ways: 

• Signed-magnitude. 

• One’s complement. 

• Two’s complement. 

In signed-magnitude representation, the sign and magnitude are specified 
separately. The first digit is the sign digit and the remaining (n — 1) represent the 
magnitude. In the binary case, the sign bit is usually selected to be 0 for positive 
numbers and 1 for negative ones. 

The ones’ complement of a binary number is defined as the value obtained by 
inverting all the bits in the binary representation of the number (swapping 0s for Is 
and vice versa). For instance, the ones’ complement of 10111 is 01000. The ones’ 
complement can represent integers in the range —(2' 1_1 — 1) to +(2" _1 — 1). 

The two’s complement of an «-bit number is another way to interpret a binary 
number. In two’s complement, positive numbers always start with a 0 and negative 
numbers always start with a 1. If the leading bit of a two’s complement number is 0, 
the value is obtained by calculating the standard binary value of the number. If the 
leading bit of a two’s complement number is 1, the value is obtained by assuming 
that the leftmost bit is negative, and then calculating the binary value of the number. 
For example, 

001 = (0 + 0 + 2°) = (0 + 0 + 1) = 1 

010 = (0 + 2 1 + 0) = (0 + 2 + 0) = 2 

Oil = (0 + 2 1 +2°) = (0 + 2+ 1) = 3 

100 = ((—2 2 ) + 0 + 0) = (-4 + 0 + 0) = -4 

101 = ((—2 2 ) + 0 + (2°)) = (-4 + 0 + 1) = -3 

110 = ((—2 2 ) + (2 1 ) + 0) = (-4 + 2 + 0) = -2 

111 = ((—2 2 ) + (2 1 ) + (2°)) = (—4 + 2 + 1) = — 1 

It is easy to check that in two’s complement representation, an n-bit word 
represents integers from —2" _1 to 2" _1 — 1. 

The range of representable numbers for two’s complement fixed-point numbers 
is illustrated in Figure 1.7. 

Two’s complement is the most common representation of signed fixed-point 
numbers and is the only representation used in MATLAB. 
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-2" -1 0 2"~ l -1 
^ Negative numbers ^ Positive numbers ^ 

Figure 1.7 Range of representable numbers for two’s complement numbers 


Fixed-point numbers can be created in MATLAB by the aid of Fixed-Point 
Designer™ using the function f i. This function produces a fixed-point number with 
default signedness and default word and fraction lengths. The default value of the 
word length is 16. For example, the fixed-point representation of —1/3 is 
a = fi(-1/3) 


-0.333328247070313 

DataTypeMode: Fixed-point: binary point scaling 
Signedness: Signed 
WordLength: 16 
FractionLength: 16 

It is possible to specify the signedness (1 for signed, 0 for unsigned) and the word 
and fraction length as follows: 
fi(-1/3,1,15,12) 


-0.333251953125000 

DataTypeMode: Fixed-point: binary point scaling 
Signedness: Signed 
WordLength: 15 
FractionLength: 12 

Several other properties of the f i object are described in [5], 

The binary representation of the fixed-point number a may be displayed by the 
command 

a. bin 


111101010101011 

The generation of unsigned fixed-point numeric object is done by the function 
uf i. 

A particular case of the fixed-point numbers are the integers. In MATLAB, the 
integers may be represented as unsigned or signed 8, 16, 32, or 64 bit variables using 
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Table 1.1 MATLAB integer representation 


Number of bits 

Unsigned integers 

Signed integers 

8 

uint8 

int8 

16 

uintl6 

intl6 

32 

uint32 

int32 

64 

uint64 

int64 


the corresponding functions, shown in Table 1.1. If, for instance, x = —81.3, its 
16 bit integer representation is obtained as 

ix = int!6(x) 


-81 

The minimum and maximum representable numbers are determined by the func¬ 
tions intmin and intmax. For instance, the commands intmin ('uint32 ') 
and intmax (' uint32 ' ) produce the minimum and maximum 32-bit unsigned 
integers, respectively, representable in the workspace of MATLAB. 

1.4.2 Scaling 

Since fixed-point numbers and results of arithmetic operations are stored in registers 
with a fixed length, there is a finite number of distinct values which can be represented 
within the computer arithmetic unit. Let A min and A max denote the smallest and the 
largest representable fixed-point numbers. The interval [Amin, A max ] is called range of 
the representable numbers. Any arithmetic operation that attempts to produce a result 
larger than N mm or smaller than N mm will give rise to an erroneous result. In such 
cases the arithmetic unit will produce a message which is called an overflow in the 
first case and underflow in the second case. 

In programing with the fixed-point notation, special care must be taken to avoid 
overflow and underflow problems while maintaining a suitable precision. For this 
reason the fixed-point numbers must be scaled. It is possible to perform scaling by 
changing the position of the binary point of a fixed-point number or by implementing 
an arbitrary linear scaling. Both options are described briefly below. 

A fixed-point number can be represented by the general slope and bias encoding 
scheme 

real-world value = (slope x integer) + bias, 
where the slope can be expressed as 

slope = slope adjustment factor x 2 flxedexponent . 
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The integer is the raw binary number, in which the binary point is assumed to be 
at the far right of the word. 

The slope and bias together represent the scaling of the fixed-point number. In 
a number with zero bias, only the slope affects the scaling. A fixed-point number 
that is only scaled by binary point position is equivalent to a number in [Slope Bias] 
representation that has a bias equal to zero and a slope adjustment factor equal to one. 
This is referred to as binary point-only scaling or power-of-two scaling : 

real-world value = 2 flxedexpo " ent x integer 


or 


real-world value = 2 fractlon length x integer. 

Fixed-Point Designer supports both binary point-only scaling and [Slope Bias] 
scaling. 

1.4.2.1 Binary-point-only scaling 

Binary-point-only or power-of-two scaling involves moving the binary point within 
the fixed-point word. The advantage of this scaling mode is to minimize the number 
of processor arithmetic operations. 

With binary-point-only scaling, the components of the general slope and bias 
formula have the following values: 

• F= 1 

. S = F2 e = 2 e 

• B = 0 

The scaling of a quantized real-world number is defined by the slope S, which is 
restricted to a power of two. The negative of the power-of-two exponent is the fraction 
length (the number of bits to the right of the binary point). For Binary-Point-Only 
scaling, the fixed-point data types can be specified as 

signed types fixdt(l, WordLength, FractionLength) 
unsigned types fixdt(0, WordLength, FractionLength) 

As mentioned previously, integers are a special case of fixed-point data types. 
Integers have a trivial scaling with slope 1 and bias 0, or equivalently with fraction 
length 0. The integers are specified as 

signed integer f ixdt (1, WordLength, 0) 
unsigned integer f ixdt (0 , WordLength, 0) 

1.4.2.2 Slope and bias scaling 

When one scales by slope and bias, the slope S and bias B of the quantized real-world 
number can take on any value. The slope must be a positive number. Using slope and 
bias, the fixed-point data types are specified as 


fixdt(Signed, WordLength, Slope, Bias) 
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1.4.2.3 Unspecified scaling 

The fixed-point data types with an unspecified scaling are set as 
fixdt(Signed, WordLength) 

Simulink® signals, parameters, and states must never have unspecified scaling. 
When scaling is unspecified, one has to use some other mechanism such as automatic 
best precision scaling to determine the scaling that the Simulink software uses. 

Example 1.2. Slope and bias scaling of a gyro sensor output 

A microelectromechanical system (MEMS) gyroscope provides 14-bit fixed-point 
measurements of angular velocity. It is necessary to scale the fixed-point signal taking 
into account that the angular velocity may vary in the range [-180,180] deg/s. 

First, enter the endpoints, signedness, and word length. 

lower_bound 
upper_bound = 180; 

word_length - 14; 

To find the range of a f i object with a specified word length and signedness, 
one may use the range function from Fixed-Point Designer. 

[Q_min, Q_max] = range(fi([],is_signed, word_length, 0)); 

To determine the slope and bias, it is necessary to solve the system of equations, 
written in MATLAB notation as 

lower_bound = slope * Q_min + bias 

upper_bound = slope * Q_max + bias 

These equations may be rewritten in matrix/vector form as 


lower_bound 

O min 11 f" slope 

upper_bound 

Q_max 1 J bias 


The vector containing the resulting slope and bias is computed by the following 
command lines: 

A = doublet[Q_min 1; Q_max 1]); 
b = double([lower_bound; upper_bound]); 
x = A\b; 

The slope, or precision, is 
slope = x(l) 


0.021973997436367 
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and the bias is 
bias = x(2) 
bias = 


0.0109869987181835 

It is convenient to create a numerictype object with slope and bias scaling 
which will be used in the generation of f i object. 

T = numerictype(is_signed,word_length,slop,bias) 


DataTypeMode: Fixed-point: slope and bias scaling 
Signedness: Signed 
WordLength: 14 

Slope: 0.021973997436366965 
Bias: 0.010986998718183483 


Now, it is easy to create a f i object with numerictype T. 
a = fi(-160,T) 


-160.003662332906 


DataTypeMode 

Signedness 

WordLength 


Fixed-point: slope and bias scaling 

Signed 

14 

0.021973997436366965 

0.010986998718183483 


Finally, it is appropriate to verify that the created fi object has the correct 
specifications by finding the range of a. 
range(a) 


DataTypeMode: Fixed-point: slope and bias scaling 
Signedness: Signed 
WordLength: 14 

Slope: 0.021973997436366965 
Bias: 0.010986998718183483 □ 

1.4.3 Range and precision 

The range of representable numbers for a two’s complement fixed-point number of 
word length n, scaling S and bias B is shown in Figure 1.8. 

Because a fixed-point data type represents numbers within a finite range, over¬ 
flows and underflows can occur if the result of an operation is larger or smaller than 
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5'.(-2"- 1 ) + B B S.(2”~' - 1) + B 

^ Negative numbers ^ Positive numbers ^ 

Figure 1.8 Range of representable numbers for scaled two s complement numbers 


the numbers in that range. As shown by Example 1.2, the overflows and underflows 
can be avoided by appropriate scaling of the corresponding variables. 

The precision of a fixed-point number is the difference between successive values 
representable by its data type and scaling, which is equal to the value of its least 
significant bit. The value 2~ m of the least significant bit, and therefore the precision 
of the number, is determined by the number m of fractional bits. A fixed-point value 
can be represented to within half of the precision of its data type and scaling. For 
example, a fixed-point representation with eight bits to the right of the binary point 
has a precision of 2 -8 or 0.00390625, which is the value of its least significant bit. 
Any number within the range of this data type and scaling can be represented to within 
(2 _s )/2 or 0.001953125, which is half the precision. 

Fixed-Point Designer software currently supports the following rounding 
methods. 

• Ceiling rounds to the closest representable number in the direction of positive 
infinity. 

• Convergent rounds to the closest representable number. In the case of a tie, 
convergent rounds to the nearest even number. This is the least biased rounding 
method provided by the toolbox. 

• fix rounds to the closest representable number in the direction of zero. 

• Floor, which is equivalent to two’s complement truncation, rounds to the closest 
representable number in the direction of negative infinity. 

• Nearest rounds to the closest representable number. In the case of a tie, nearest 
rounds to the closest representable number in the direction of positive infinity. 
This rounding method is the default for f i object creation and f i arithmetic. 

• Round rounds to the closest representable number. In the case of a tie, the round 
method rounds: 

- positive numbers to the closest representable number in the direction of 
positive infinity. 

- negative numbers to the closest representable number in the direction of 
negative infinity. 

Recommendations about the choice of rounding methods for fixed-point numbers 
are given in [5], 

1.4.4 Fixed-point arithmetic operations 

1 . 4 . 4.1 Addition and subtraction 

In the addition of two fixed-point numbers, it may be necessary to have an additional 
(carry) bit to correctly represent the result. For this reason, when adding two n-bit 
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numbers (with the same scaling), the resulting value has an extra bit compared to 
the two operands used. For example, consider the addition of the numbers 0.3749 
and 0.5681 which are represented in fixed-point arithmetic with word length 12 and 
fraction part length 8. The result has word length 13 and fraction part length 8. 
a = fi(0.3749,0,12,8) 


0.375000000000000 

DataTypeMode: Fixed-point: binary point scaling 
Signedness: Unsigned 
WordLength: 12 
FractionLength: 8 

b=fi(0.5681,0,12,8) 

b = 


0.566406250000000 


DataTypeMode: 
Signedness: 
WordLength: 
FractionLength: 


Fixed-point: binary point scaling 
Unsigned 


0.941406250000000 


DataTypeMode: Fixed-point: 
Signedness: Unsigned 
WordLength: 13 
FractionLength: 8 


binary point scaling 


000001100000 


000010010001 



0000011110001 
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If one adds or subtracts two numbers with different precision, the radix point 
first needs to be aligned to perform the operation. The result is that there is a differ¬ 
ence of more than one bit between the result of the operation and the operands. For 
instance, 

a = fi(0.3634,0,12,8); 
b = fi(5.2987,0,16,12); 
c = a + b 


5.661865234375000 

DataTypeMode: Fixed-point: binary point scaling 
Signedness: Unsigned 
WordLength: 17 
Frac tionLength: 12 

Fixed-point subtraction is equivalent to adding while using the two’s complement 
value for any negative values. To compute the negative of a binary number using two’s 
complement, one may perform the following operations: 

1. Take the one’s complement, or “flip the bits.” 

2. Add a 2~ m using binary arithmetic, where m is the fraction length. 

3. Discard any bits carried beyond the original word length. 

For instance, the negative of 01101 (13) is 10011 (—2 4 + 2 1 + 2° = —13). 

1.4.4.2 Multiplication 

In the general case, a full precision product of two fixed-point numbers requires a 
word length equal to the sum of the word lengths of the operands. In the following 
example, the word length of the product c is equal to the word length of a plus the 
word length of b. The fraction length of c is also equal to the fraction length of a plus 
the fraction length of b. 

a = fi(4.2961,1,20) 


4.296096801757813 

DataTypeMode: Fixed-point: binary point scaling 
Signedness: Signed 
WordLength: 20 
FractionLength: 16 

b = fi(2.167,1,18) 

b = 


2.166992187500000 
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DataTypeMode 

Signedness 

WordLength 

FractionLength 


Fixed-point: 

Signed 

18 

15 


binary point scaling 


9.309608206152916 


DataTypeMode: 
Signedness: 
WordLength: 
FractionLength: 


Fixed-point: binary point scaling 

38 

31 


1.5 Floating-point arithmetic 

A major disadvantage of the fixed-point numbers is that their range is much less than 
the range of floating-point values with equivalent word sizes. Also, the scaling of 
floating-point numbers is done automatically which facilitates the usage of floating¬ 
point arithmetic. 


1.5.1 Floating-point numbers 

The floating-point number system F is characterized by the base b, the precision p 
and the exponent range e m i n , e max . Here, b and p are positive integers, e m j n is a negative 
integer and e max is a positive integer. In this system, each p-digit base b floating-point 
number is represented in the normalized form 


x = ±0 .did 2 .. .d p x b e 

, M d 2 d p \ 

= ± {-b + F + - + i) 

= ±/x b e . 


b e 


where 


1 < di < b, 

0 <d t <b i = 2,3,... ,p 

and e m i n < e < e max . The integer e is called the exponent and the number /—the 
fractional part or mantissa. 

The most frequently used number bases are 2, 8, 10, and 16. 

The smallest positive number, represented in the floating-point system, is 






Embedded control systems 23 


■v | g(s3gjg) | /(gUfe) 

0189 31 

Figure 1.9 Single precision 32-bit word 


s | e (11 bits) | / (52 bits) 

01 11 12 

Figure 1.10 Double precision 64-bit word 


63 


Table 1.2 IEEE arithmetic parameters 


Precision 

P 

E min 

E m „ 

bias 

e 

Single 

24 

-126 

127 

+ 127 

2~ 24 « 5.96 x 10 -8 

Double 

53 

-1,022 

1,023 

+ 1,023 

2 -53 * 1.11 x 10“ 16 


and the largest one is 

M = b e ™*( 1 - b~ p ). 

On some computers two floating-point systems are used which are called single 
precision and double precision. These system are characterized by different values of 
p, e mm and e max . 


1.5.2 IEEE arithmetic 

The binary floating-point arithmetic standard 754-2008 [6], or subset of it, is com¬ 
monly called “IEEE arithmetic.” Virtually all modem processors implement IEEE 
arithmetic. In this standard, the single precision arithmetic is characterized by b = 2 
and p = 24. The corresponding 32-hit word is organized as shown in Figure 1.9. 

Two 32-bit words for double precision arithmetic are organized as shown in 
Figure 1.10. 

A floating-point number is represented in IEEE arithmetic as 

{-\) s 2 E (bo.b l b 2 ...b p . l ), 

where s = 0 or 1 determines the number sign, E is any integer between E mm and £ max , 
b L = 0 or 1 for i = t,...,p— 1, e = E + bias, where bias is used to avoid having 
a bit, corresponding to the exponent sign. Note that the bit bo is not used explicitly, 
since the floating-point number is normalized, i.e., b 0 is always equal to 1. 

The parameters of the single precision and double precision arithmetic are shown 
in Table 1.2. 
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rrioKiuo-no-iOioiaiototoioiOiOioiil 

0189 31 

Figure 1.11 Binary presentation of— 1 /3 in single precision 


Example 1.3. Representation of —1/3 in IEEE arithmetic 

The number — 1 /3 is represented in the single precision IEEE arithmetic as shown in 
Figure 1.11. This is checked in MATLAB by using the command lines 

format hex, single(-1/3) 


beaaaaab 

and converting the hexadecimal number beaaaaab to binary number. □ 

A special bit pattern called NaN (“Not a Number”) with e = 255 and/ ^ 0 is 
generated by operations like 0/0, Oxoo, oo/oo, and (+ oo) — (+ oo). Arithmetic 
operations involving a NaN return NaN as an answer. 

The infinity symbol is represented by / = 0 and the same exponent field as a 
NaN, the sign bit distinguishing between ±oo. 

Zero is represented by e = 0 and / = 0, with the sign bit providing distinct 
representation for +0 and -0 which can be useful in some cases. 

In MATLAB, the permanent variables realmin and realmax represent 
the smallest positive and the largest positive normalized floating point numbers, 
respectively. 

Let x be any real number which satisfies 
m <x < M 

The rounded value fl(x) of x is defined as the floating-point number which is 
nearest to x and the transformation x —> fl(x) is called rounding. There are several 
ways to break ties when x is equidistant from two floating-point numbers, including 
taking fl(x) to be the number of larger magnitude (round away from zero) or the 
one with an even last digit d p (round to even). The default rounding mode in IEEE 
arithmetic is to round to the nearest representable number, with rounding to even 
(zero least significant digit), in the case of a tie. Other supported modes are rounding 
to plus or minus infinity and rounding to zero. The last mode is called truncation 
or chopping. If fix) > M one says that fl(x) overflows and if 0 < fl(x) < m than it 
underflows. 

It is possible to show that every real number x lying in the range of F can be 
approximated by an element of F with a relative error no larger than 
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in the case of rounding to even and 
e = b~ p 

in the case of truncation. The quantity e is called unit roundoff. In case of IEEE 
arithmetic, the values of s for single precision and double precision computations are 
given in the Table 1.1. Notice that e^> m. 

In MATLAB, eps without arguments produces the quantity b~ p which is two 
times larger than the unit roundoff e corresponding to correct rounding. 

If x lies in in the range of F one has that 

fl(x) = x(l + S), |<5| < e. (1.2) 

1.5.3 Floating-point arithmetic operations 

Assume that x, y are floating-point numbers. According to the IEEE standard, all 
arithmetic operations involving x and y are to be performed as if they were first 
calculated to infinite precision and then rounded according to one of the four modes. 
This lies to the following model of the basic arithmetic operations. 

fl(x op y) = (x op y)( 1 + 5), \S\ < e, op = (1.3) 

The model says that the computed value of x op v is “as good as” the rounded 
exact answer, in the sense that the relative error bound is the same in both cases [7]. 
Likewise, one may assume that 

fllsTA = V^(l + 5), |<5| < e. (1.4) 

The model (1.3), (1.4) is basic in the error analysis of floating-point computations. 


1.6 Quantization effects 


MATLAB file used in this section 


File 

Description 

sampling_adc 

Step responses for different A/D 
converters 


The conversion of analog quantities into binary signals in digital devices is asso¬ 
ciated with the introduction of quantization errors which may affect the stability and 
performance of the corresponding control systems. 

1.6.1 Truncation and roundoff 

As shown in the previous sections, the representation of numbers in fixed-point or 
floating point arithmetic may lead to errors. Denoting the number before quantization 
as x, the error introduced by quantization is 
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Figure 1.12 Truncation errors in fixed-point arithmetic 


where x q is the quantized value of x. The range of the quantization error depends on 
the type of arithmetic (fixed-point or floating point), the type of rounding (trunca¬ 
tion, rounding to the nearest representable number, etc.). In fixed-point arithmetic, 
truncation or roundoff errors are independent of the magnitude of the unquantized 
number x. 

In Figure 1.12, we show the static characteristic (x q as a function of x) of a digital 
device and the behavior of the truncation error in the case of fixed-point arithmetic 
with two’s complement representation. The truncation error e q in this case satisfies 
the inequality 

—2~ m < e q < 0 


for all x, where m is the fractional part length of x q . 

In case of fixed-point arithmetic with rounding to the nearest representable 
number, the static characteristic of the device and the behavior of the rounding error 
are shown in Figure 1.13. In this case one has that 
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In floating point arithmetic, the truncation and roundoff errors depend on the 
magnitude of the unquantized number. According to (1.2) one has that for x ^ 0 the 
relative quantization error is given by 

\S\ < e, (1.5) 

where e depends on the rounding mode. In the case of truncation e = 2~ p and in the 
case of rounding to the nearest representable number e = \2~ p where p is 24 or 53 
for IEEE single or double precision, respectively. 

Apart of the number representation, the rounding error may have significant effect 
on the arithmetic operations performed during the computation of control actions in 
an embedded control system. At first glance, the relative error (1.5) in the arithmetic 
operations is small, especially in the case of double precision arithmetic. In some 
computations, however, such errors may lead to large errors in the final result, due to 
catastrophic floating point cancelations. The theoretical analysis of this effect in case 
of complicated high-order controllers is difficult. The most reliable way to analyze 
the effect of rounding errors is to simulate the closed-loop system taking into account 
the precision of different signals and control action computations. 
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Figure 1.14 Simulink block diagram of discrete-time system 


1.6.2 Quantization errors in A/D conversion 

The conversion of analog quantities into binary signals in the digital sensors is equiv¬ 
alent to the introduction of quantization noise which is an example of discrete-time 
white noise. If the full scale measurement range of analog quantity is S and if the A/D 
converter has p bits resolution, then the quantization noise may be represented as a 
zero mean white random process having a uniform probability density from —q/2 to 
q/2 where q = S/2 P is the quantum size. It is possible to show [8, Chapter 10] that 
this quantization noise has strength equal to 



For example, a shaft p -bit encoder with full measurement range S = 2it has a 
quantization noise whose strength is given by 



The quantization error of A/D converters may deteriorate the closed-loop system 
performance as demonstrated by the following example. 


Example 1.4. Influence of the ADC precision on system performance 

Consider a discrete-time system whose Simulink block diagram is shown in Figure 
1.14. The system involves a continuous-time second-order plant described by the 
transfer function 

c _ Kq 
ry + 2%t oS + i 


with parameters K 0 = 20, T 0 = 1.0, and £ = 0.1, discrete-time controller with 
transfer function 


K d = 33.333 


z - 0.9854 
z- 0.5134 


and an ADC converter, modeled as a Quantizer block in Simulink. The sampling 
time of the ADC is T s = 0.02 s. 
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Time (s) 

Figure 1.15 Unit step responses for different ADC 


In Figure 1.15, we present the unit step responses of the closed-loop system for 
different ADC with resolution 4 bits, 6 bits, and 8 bits, respectively. It is seen that 
the step response for 4 bits ADC becomes oscillatory, due to the large dead zone of 
the ADC. □ 


1.7 Design stages 


MATLAB file used in this section 


File 

Description 

sampling_period 

Step responses for various 
sampling intervals 


The design of embedded control systems with MATLAB and Simulink is 
described in simplified form as follows. 

The process of controller design, controller code generation, and embedding 
of the code in the digital computer is shown in Figure 1.16. The discrete-time 
controller structure and parameters are determined in MATLAB based on plant, 
sensor and actuator models incorporating disturbances and noises. For this aim the 
designer uses general purpose toolboxes such as Control System Toolbox™, Robust 
Control Toolbox™, System Identification Toolbox™, Optimization Toolbox™, 
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Figure 1.16 Design of embedded control system with MATLAB 


Signal Processing Toolbox™ or special purpose toolboxes like Aerospace 
Blockset™ and Robotics System Toolbox™. The controller description is obtained 
in the form of discrete-time state-space equations or transfer functions. A controller 
model, based on this description, is built in Simulink using appropriate blocks. Using 
the tools for code generation (Simulink® Coder™ and Embedded Coder® or HDL 
Coder™) a C and C++ code is generated and embedded in the target computer. 
Specifically, the design process may involve the following main stages. 

• Plant modeling 

The plant model is obtained by theoretical modeling based on first (physical) 
principles or experimental modeling (identification) using measured input and 
output variables. Generally, the plant model may contain parts, described by 
nonlinear algebraic or differential equations. For the purpose of controller design, 
these equations are linearized and discretized. Some plants have parameters that 
are not known exactly or may vary in some intervals. Instead of using a single 
plant model, this may lead to the necessity of using a family of plant descriptions. 
The determination of appropriate plant model is a difficult stage of system design 
which may require a large volume of theoretical and experimental work. Note 
that the building of good plant model represents an iterative process aimed to 
fulfill the closed-loop system performance requirements. 

The plant modeling is considered in more details in Sections 1.2.1 and 1.2.5. 

• Controller design 

The modem control theory offers a rich variety of methods intended for controller 
design. These include linear and nonlinear controllers designed by using different 
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techniques. In this book, we focus on the linear controllers designed by using the 
optimal and robust control theory. The purpose of these controllers are to ensure 
precise tracking of reference commands in the presence of deterministic and 
stochastic disturbances and plant parameter variations. Depending on the plant 
and disturbances model order, the controller order may have to be reduced in order 
to implement the controller algorithm in real time. Note that the contemporary 
microcontrollers make possible to use complicated high-order control laws even 
for sufficiently small sampling periods. For instance, linear controllers up to 
50th order can be implemented without difficulties in case of sampling periods 
larger than 0.001 s (1 kHz sampling frequency) on microcontrollers with clock 
frequency 150 MHz. 

• Software-in-the-loop simulation (SIL) 

In SIL testing, the system hardware is represented entirely by software models 
in Simulink. Initially, the software models may work in full (double) precision, 
but at a later stage, they can take into account the different precision of sensors, 
actuators, and controller. The operational software is automatically generated 
from Simulink models and tested in a non-real-time simulated environment for 
different references, disturbances and noises. 

• Rapid control prototyping 

The aim of rapid control prototyping is a real-time controller simulation (emu¬ 
lation) with hardware (e.g., off-the-shelf signal processor) other than the final 
series production hardware may be performed. It is used to test software control 
algorithms in a real-time environment before implementing code on an embedded 
processor. The plant, the actuators, and sensors can then be real. The rapid control 
prototyping may reduce the models and algorithms to meet the requirements of 
cheaper mass production hardware and help in defining the specifications for 
final hardware and software. 

• Processor-in-the-loop (PIL) simulation 

When the real-time embedded processor is available, the operational soft¬ 
ware is tested in the real-time embedded processor, using simulated hardware. 
This PIL testing validates software functions and performance. In this phase 
of testing, estimates of processor throughput, memory, and timing are also 
obtained. 

• Hardware-in-the-loop (HIL) simulation 

After the PIL test, the operational software and prototyped hardware are ready 
for HIL testing, which is used to verify the integrated functional and opera¬ 
tional performance. Based on the test data, a fine timing of the regulators and 
filters is done and the closed-loop system performance is verified to meet 
requirements. 

The advantages of the HIL simulation are [2, Chapter 2], 

• Design and testing of the control hardware and software without operating a real 
process (“moving the process field into the laboratory”) 
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Figure 1.17 Digital implementation of “analog ” type controller 


• Testing of the control hardware and software under extreme environmental con¬ 
ditions in the laboratory (e.g., high/low temperature, high accelerations and 
mechanical shocks, aggressive media, and electromagnetic compatibility) 

• Testing of the effects of faults and failures of actuators, sensors, and computers 
on the overall system 

• Operating and testing of dangerous operating conditions 

• Reproducible experiments, frequently repeatable 

• Easy operation with different man—machine interfaces 

• Saving of cost and development time 

HIL simulation of different controllers is described in Chapter 4. 

1.7.1 Controller design 

As it is well known (see for instance [4]), the design of discrete-time controllers can 
be carried out in two distinctly different ways. The first approach is illustrated in 
Figure 1.17. According to this approach, the controller is designed in continuous¬ 
time and then one derives a discrete version of it using some discretization method. 
The advantage of this approach is that the performance specifications are done in 
the continuous-time domain and the design is fulfilled by using the well-developed 
methods for continuous-time system design. In this case, the cascade A/D—Digital 
computer—D/A behaves like an analog controller provided the sampling frequency 
is sufficiently high. With the increasing of the sampling period the behavior of the 
discrete-time closed-loop system deviates from the behavior of the continuous-time 
system which leads to the deterioration of closed-loop performance. 

Example 1.5. Influence of the sampling period on system performance 

Consider again the discrete-time system whose Simulink block diagram is shown in 
Figure 1.14. The plant transfer function is 

c _ K 0 

ry + t oS + i 

with parameters K„ = 20, T a = 1.5, and f = 0.1. 
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Time (s) 

Figure 1.18 Unit step responses for different sampling periods T s 


A continuous-time controller with transfer function 


Tis + 
T 2 s + 1 


where c = 4, 7) = 0.5, T 2 = 0.03, ensures an acceptable performance of the closed- 
loop system. This controller is discretized for three different sampling periods 
T s = 0.01, T, = 0.015, and f = 0.02 s. The corresponding closed-loop unit step- 
responses and control actions are shown in Figures 1.18 and 1.19, respectively. It 
is seen from Figure 1.18 that the overshoot of the system response increases from 
16 percent (the case of continuous-time controller) to 30 percent (discrete-time con¬ 
troller for T s = 0.02). This shows that the approach using continuous-time controller 
has limited capabilities especially for large sampling periods. □ 


The alternative approach to the design of discrete-time systems is illustrated in 
Figure 1.20. With this approach, one discretizes the continuous-time plant model 
and performs the controller design in discrete time. The performance specifications 
are usually formulated in continuous-time due to the clear physical interpretation 
in this case. After plant discretization, a discrete-time controller is computed which 
may be implemented directly for simulation or real-time control. The usage of such 
approach avoids the performance degradation and the computational errors which 
might be introduced in converting a continuous-time controller to discrete-time. For 
better results, in this book we try to adopt the second approach. 

Different controller design methods are represented and compared in 
Chapter 4. 
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Figure 1.19 Control actions for different sampling periods T s 



Figure 1.20 Digital system with dedicated discrete-time controller 


1.7.2 Closed-loop system simulation 

The controller design is usually followed by simulation of the closed-loop system and 
assessment of the system performance. In practice, it is not easy to find appropriate 
controller after the first attempt, so that the procedure consisting of controller design 
and simulation is repeated iteratively until an acceptable solution is found. 

Initially, the simulation is done by using a simplified linearized model as the 
one shown in Figure 1.21. This model reflects the plant behavior in a single equi¬ 
librium state and may not take into account the effect of disturbances and noises. In 
case of time-invariant systems this allows to find relatively quickly the structure and 
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Figure 1.21 Simulation of a linear system 



the approximate controller parameters using simple simulation methods, like step, 
lsim and dlsim from MATLAB. At this stage of the simulation, it is also appro¬ 
priate to use an uncertainty plant model in order to verify the closed-loop robustness. 
For this aim one may use the uncertainty models presented in Section 1.2.5. 

After an appropriate controller is found, a more complicated system model can 
be used, as shown in Figure 1.22. It involves nonlinear plant model, specific equilib¬ 
rium point determined by the trim values of control and output variables, as well as 
disturbances and noises. This model is made more and more involved, reflecting the 
different precision used by sensors, actuators, and controllers, and including more 
nonlinear effects (nonlinear static characteristics, friction, etc.). The price to be paid 
for such refinements is the increasing computational time necessary to simulate the 
system. In this case it is necessary to pay some attention to the choice of appropriate 
method for integration of the plant differential equations, choice of integration step 
and studying the system behavior between sampling instances. 

In case of uncertain parameters it is appropriate to use the Monte-Carlo simulation 
technique. 

The Monte-Carlo simulation is a heuristic method which consists of random 
sampling the uncertain model parameters and simulation of the closed-loop system for 
various fixed values of these parameters in the uncertainty range. The averaged model 
responses then give an impression about the closed-loop system behavior in real-world 
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conditions. The Monte-Carlo technique is especially convenient in the simulation of 
uncertain nonlinear system when it is difficult to use analytical methods to assess 
the closed-loop performance. Simulink makes possible to use easily the Monte Carlo 
method in case of uncertain models. 

Examples of Monte-Carlo simulation are given in Chapter 4. 

1.7.3 Embedded code generation 

After a suitable controller is determined, it is possible to go to the next design step 
generating control code from the Simulink control model. 

Using the MATLAB and Simulink capabilities, the designer can generate auto¬ 
matically the control code which increases efficiency, improve performance, and 
promote the innovation of control algorithms. 

One of the widely used technologies for automatic generation of code intended for 
loading in microcontrollers and digital signal processors is based on the programing 
tools Simulink Coder™ and Embedded Coder, which are included in the programing 
system MATLAB. 

The Simulink Coder (with former name Real-Time Workshop) generates and 
executes C and C++ codes from Simulink block diagrams, diagrams of Stateflow®, 
and MATLAB functions. The generated output code can be used in applications in 
real time and non-real time including accelerated simulation, rapid prototyping, and 
HIL simulation. The generated code can be tuned and debugged using Simulink or 
can be executed out of MATLAB and Simulink. 

Embedded Coder generates compact and fast C and C++ code for using on 
embedded processors and microcontrollers for mass production. Embedded Coder 
gives additional opportunities for configuration MATLAB Coder and Simulink Coder 
and optimization of the generated code, files, and data. These optimizations improve 
the code efficiency and facilitate the integration with previous code, data types, and 
calibration parameters, used in the embedding. The Embedded Coder supports SIL 
and PIL simulations. 

To generate diagrams for embedding in FPGA, one uses the program systems 
Simulink and HDL Coder. Initially, a diagram model is created in Simulink after 
that the diagram is translated in the hardware description language (HDL) VHDL and 
then it is passed on the custom software products, submitted by the device producer. 
Then, after design, visualization, and wiring, a configuration file is generated, which 
is loaded in the FPGA device. This process is automatized, so that the designed works 
only in Simulink environment and makes fine tuning in the rest environments. 

The embedded code generation is considered in more details in Section 1.9. 


1.8 Hardware configuration 

Generally, the interface between control algorithm and target machinery provided 
by embedded system can be decomposed into hardware and software configuration. 
The hardware configuration supplies an execution environment of interconnected 
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electronic devices. This environment should be capable of fast and deterministic 
actions ordered in predefined but conditional sequence which is called program. It is 
planned by the system designer and written inside digital memory. Another hardware 
function is continuous processing of information packed in discrete emits of data. 
This section will briefly discuss and demonstrates how a hardware configuration is 
developed. 

The basic building block of digital electronics is the transistor working as a two- 
state switch. Switching behavior of these building elements puts the design with 
them in domain of Boolean algebra and discrete mathematics. Nowadays transistors 
for computing are scaled down to nanometer units to allow faster switching between 
states and larger spatial density. Integral circuits such as microcontroller or FPGA are 
made of millions of transistors printed on a piece of silicon base (called a chip). Here 
comes the problem of complexity in design—a large number of simple elements have 
to be interconnected with exponentially increasing number of connections to achieve 
some useful function. Since humans can work with limited number of elements in 
a time the best way of building a complex system is through modular approach. A 
module introduces a level of isolation of its internal mechanism and provides a con¬ 
venient external user interface. When module design is completed there is no need 
to consider its internal working during the next design phase as long as its interface 
stays compatible. The complexity in integral circuit design is managed through intro¬ 
duction of levels of increasing granularity. Design is hierarchically organized such 
that each module from a given level is composed of modules from the level below. 
Resultant tree of modules supports all device functions and target system design has 
to account at least for highest levels of that architecture. 


1.8.1 Microprocessing architectures 

Microarchitecture concerns interconnections inside an integrated circuit. Since the 
distances between semiconductor switches are several nanometers the distances 
between modules of these building blocks are in the micrometer range. There are 
several key computing architectures which are common in embedded control. A typ¬ 
ical microcontroller architecture is presented on Figure 1.23. It is organized around 
two main buses—memory bus and peripheral bus. Each bus is composed of large 
number of logical signals carrying addressing information—typically 32 lines for 
address, 32 lines for data, clocking signal for synchronization, request and response 
signals for line arbitration. 

The central element is central processing unit (CPU). There are mainly two kind 
of architectures of CPU nowadays—complex instruction set computer and reduced 
instruction set computer (RISC). For embedded application more common are RISC 
architectures like ARM, MIPS, SPARC, PowerPC, and other custom company 
specific. CPU executes instructions from the program with the help of its internal 
control logic and storage resources (registers)—Figure 1.24. Each instruction is a data 
unit which encodes an operation upon one or several operands. An instruction decoder 
inside CPU determines operation and operands. Next, the operands are distributed 
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Memory bus Peripheral bus 



Figure 1.23 Typical microcontroller architecture. CPU, central processing unit; 

FPU, floating-point unit; IC, interrupt controller; PLL, phase-locked 
loop; OSC, oscillator; SRAM, static random access memory; ADC, 
analog to digital convertor; SCI, serial communication interface; 
PWM, pulse width modulation; CAP, capture module; SPI, 
synchronous peripheral interface; GPIO, general purpose 
input/output 



Figure 1.24 CPU principal operation 

to internal CPU resources and the operation selects particular logical function to be 
applied with them. 

The three key CPU resources are instruction counter which point to the address of 
next instruction that is read from SRAM or Flash memory, a set of general or special 
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i Address bus 
l Data bus 


Figure 1.25 Typical bus architecture (arbitration signals not shown) 


purpose registers for computation, addressing and flow control, an input/output 
communication module supporting memory bus control. 

There are several hardware units closely supporting CPU operation—FPU, 
OSC and PLL, IC. Floating-point unit extends CPU mathematical capabilities with 
floating-point operations which are important in scientific calculation and in many 
higher order control systems. Microcontrollers are synchronous devices, all signal 
events (logical level changes) inside them are synchronized with clock signal edges. 
Clock signals in the microcontroller derive from a CPU clock signal with the help 
of PLL feedback system. Master CPU clock is generated by an OSC module with 
the help of external crystal with fixed resonant frequency. Real-time systems must 
be responsible to external events represented as logical signal level changes. The 
response time r is a critical parameter and should be several times smaller than con¬ 
trol system sample time T s . Interrupt controller (IC) registers external to CPU events, 
holds current program execution and loads interrupt service program (ISR). After 
completion of ISR the CPU returns to main program execution. 

Devices which require high rate of CPU communication (10-100 MHz) like 
memory devices or A/D convertors are located on a CPU memory bus. Other devices 
which operate at slower rate (10-100 kHz) are located on a secondary peripheral 
bus. Devices on memory bus can access devices on peripheral bus through a bridge 
device. It translates addresses, synchronizes clock rate and buffers data. Peripheral 
devices are usually low-speed communication devices (SCI, SPI, I2C), signal gen¬ 
erators (PWM, DAC, sensors) or event captures (CAP). Each device has a function 
specific architecture supporting its function. Most of the microcontroller pads are 
defined as general purpose (GPIO) and work as a routing station. The program can 
configure each GPIO pad as input, output, or peripheral signal. 

Several devices share a common information media called bus to achieve data 
integrity between them (Figure 1.25). In microcontrollers, usually, the CPU is bus 
master and the rest devices are bus slaves. All information inside slave devices is 
represented as a set of 32-bit registers (memory cells) and each register has its unique 
32-bit address for the bus. A register works as a sequence of binary states which are 
related to slave device functions. For example, to start an ADC the program switches 
a particular state inside ADC control register. Since CPU is the bus master device 
only it can generate addresses to access internal device registers. All registers of 
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Device 


Figure 1.26 Memory map and peripheral device control 



Figure 1.27 Typical smart sensor architecture 


a microcontroller are described by the memory map which is always presented in 
documentation. 

In the beginning of address space is an interrupt vector table. Each interrupt 
vector contains the address of ISR which is started when a particular event occur. After 
the interrupt table there are memory bus devices mapped—SRAM, Flash, and ADC 
(Figure 1.26). At the end of address space are located registers of peripheral devices. 
These last addresses are translated to peripheral bus addresses by the Bridge Device. 
When developing a device driver for a particular device there should be considered 
its internal architecture. Here, we will present briefly some of architectures common 
in such peripherals. 

Much of modem sensors are scaled down to integrated circuits using microme¬ 
chanical structures like springs, levers, or oscillating masses, called MEMS. 
Figure 1.27 presents the internal architecture of such a MEMS device. The probe 
subsystem reveals information about physical variable (like velocity, temperature, 
or pressure) through specific geometric, material, or resonance phenomena. This 
information reflects on some component of electrical circuit (Transducer). Produced 
raw electrical signal have to be amplified and filtered to expose further the useful 
information about measured physical variable. ADC converts the conditioned signal 
to digital format which is recorded in sensor memory location (Registers). As noted, 
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Figure 1.28 Typical serial communication device architecture 


registers transfer their data to CPU through peripheral bus or some serial interface like 
synchronous peripheral interface (SPI) . Dedicated state machine controls the mea¬ 
surement process by generating testing stimuli for excitation of mechanical structure 
of probe. State machine also manage communication with the host. 

Serial communication transmits data over single electrical line with binary states 
(Figure 1.28). Since only 1 bit can be presented on the line in a moment, the data 
must be represented as a sequence of bits distributed over available time slots. This 
is in contrast to bus data transmission where multiple parallel lines carry all the bits 
of data word. In asynchronous communication, the clock signal isn’t transmitted to 
the receiver and in synchronous communication it is. Generated clock signal defines 
the boundaries of available time slots for data transmission. Dedicated shift registers 
convert data from parallel to serial form in tact with the clock signal. Due to differ¬ 
ences in bus and serial line rates of operation FIFO (first-in-first-out) buffers store 
temporally abundant data. These buffers are with limited size and when they are full 
or empty the CPU is signaled through the interrupt line. 

1.8.2 Hardware description language 

The main design tool for microstructures from the previous subsection is HDL. Most 
popular UDLs are Verilog and VHDL. They are similar in syntax and here we con¬ 
sider only the VHDL. It is a derivative from Ada which is the ancestor of Pascal. 
In contrast to common programing languages which support only sequential control 
flow HDL support also concurrent operations. HDL represents internal state of an 
electronic module as signals or variables. The signal is physical wire connecting two 
points. Signal level is usually voltage in digital circuits taking one of three states 
(high, low, high-impedance). Signal can have only one driver point which controls its 
level possibly as a function of other signals or variables. Variable is an internal state 
which is sequentially processed before to drive a signal. Ultimately in implementation 
all variables are mapped to signals. A skeleton of VHDL program is shown in List¬ 
ing 1.1. The process block defines processing of input signals from its sensitivity list 
to output signals using some internal variables. Hence VHDL has operations either 
for variables or signals. 
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Listing 1.1 General structure ofVHDL program 




Figure 1.29 HDL translation process 


After HDL description, the design is translated to register transfer level (RTL) 
schematic which looks like logical circuit (Figure 1.29). Every such circuit is decom¬ 
posed to combinatorial (static) and sequential (dynamic) subsystems. Combinatory 
logic defines all the values of a multivariable logical function with some basic 
elements (OR, AND, NOT gates, or XOR gates). Sequential logic is made of sim¬ 
ple memory elements (triggers) which can store a current state of a signal. RTL 
schematic is then translated to silicon technology specific primitives which are imple- 
mentable on the chip. Two optimization procedures define final configuration of 
the microarchitecture—for primitive placement and for routing of interconnections. 
Configuration file can be implemented on ASIC (application specific integrated 
circuit) or on FPGA. 

The three possible programing styles with VHDL are behavioral (Figure 1.32), 
structural (Figure 1.30), or dataflow (Figure 1.31). Same function can be achieved 
using behavioral or structural approach but these ways of programing are two 
alternatives and can’t be mixed. Data Flow models integrate behavioral and struc¬ 
tural programing style through employment of basic principles from control system 
theory—causality, concurrency, and dynamics. 

Data is numerical information related to the model which is either a signal if it 
varies with time or a parameter if it being time invariant. In data flow programing, one 
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process (elk) 

variable delay_out : std_logic; 

variable integrator_out : unsigned(3 DOWNTO 0); 

variable switch_out : unsigned(3 DOWNTO 0); 

variable sum_out : unsigned(3 DOWNTO 0) ; 

begin 

if elk'event and elk = '1' then 
Delay_out := set; 
integrator_out := sum_out; 
end if; 

sum_out := switch_out + unsigned(Value); 
if (set and (not delay_out)) = 'O' then 
switch_out := integrator_out; 
else 

switch_out := to_unsigned (16#2#, 4); 
end if; 

lvalue <= std_logic_vector (integrator_out); 
end process; 


Figure 1.30 Behavioral program 


fd Maddsumoutl ffle 



Figure 1.31 Structure Program (D triggers 2 and 3 of “integrator_out_” not 
visible) 


could express sequence of operations like in behavioral language because of causality 
relation between blocks. At the same time, he/she could decompose the system into 
independent modules like in hardware schematic because of concurrency relation. 
All blocks share same mathematical description (in Simulink as hybrid dynamical 
system) which could be easily ported to hardware or software program. 
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Figure 1.33 OSI model conformance of serial communication 


Clear representation of directed system activity is important advantage of these 
models because one can easily understand how intended function emerges from the 
collection of simple blocks. When a diagram is mapped into a hardware, the input 
data of each block affects its output data after some hardware dependent time delay. 
Therefore, one can follow the shift of current information through diagram in timely 
manner which creates the impression of a flow. 

1.8.3 Module level development 

This subsection presents how to design a simple asynchronous serial interface con¬ 
troller, compatible with RS232 standard and implement it on Spartan-3E FPGA, 
through automatic HDL code generation and hardware synthesis. Simulink HDL 
coder is a tool that can produce VHDL or Verilog description from Simulink dia¬ 
grams. Generated code is compatible with standard synthesis tools and environments 
offered by FPGA vendors, for example, Xilinx Inc. 

The interconnection between communicating devices must have layered archi¬ 
tecture (Figure 1.33). For embedded applications typical communication system is 
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Figure 1.34 Schematic representation of typical serial data frame 
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Figure 1.35 Simulink diagram of asynchronous serial receiver 


composed of application layer (AL), data-link layer, and physical layer. For transmis¬ 
sion, the controller converts a byte to a sequence of hits, then forms a message frame 
hy addition of protocol information (Figure 1.34) and transfers the bits one by one. 
Reception is a reverse process. Asynchronism results from undefined timing between 
consecutive messages because there is no shared timing system between devices. 
Each message is composed of one start bit, 5-8 data bits, 1-2 stop bits and optional 
parity bit. Parameters for the presented here UART controller are: 115,200 bps baud 
rate, 8 data bits, 1 stop bit, no parity. 

To model a serial controller in Simulink, we need to represent it in state-space 
form. The controller is composed of two subsystems—receiver module (Figure 1.35) 
and transmitter module. For modeling of digital devices, it is convenient to represent 
corresponding Simulink model in discrete time. Simulation configuration is set to 
fixed step discrete solver with sample time T s = 1 clock period. 

Unit delay block stores, the current state of each module. It acts as a 
D-Trigger. Embedded MATLAB Function block represents system transfer func¬ 
tion. This block allows describing system behavior in the algorithmic language of 
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Table 1.3 States of receiver 


Name 

Size (bit) 

Description 

Data_From 

8 

Data register 

baud_counter 

9 

Baud rate counter 

bit__counter 

4 

Number of received bits 

rxd_last 

1 

Last state of RXD line 

rec_en 

2 

Stage of reception 

dent 

5 

Delay counter 


Listing 1.2 Pseudocode for receiver subsystem 



MATLAB. The block executes each time step only once, according to static rela¬ 
tionship. Input port and Output port blocks in Simulink model correspond to in port 
and out port declarations of the generated entity definition in VHDL. Each Simulink 
signal is associated with specific data type for data it carries. Data type conversion 
blocks are used to change the data type of a signal. 

Receiver module has one input state of RXD signal line. It has two outputs. First 
is the content of data register, containing last received byte. Second is a signal line 
which is asserted when reception is completed, to inform higher processing layers. 
Receiver module has six states (Table 1.3). Three of them are for counters. Others 
are for storage of received byte, for detection of start bit (rxd_last), and for stage of 
reception. Reception is a three-stage process. First, a start bit is detected. Second, a 
delay counter is waited to finish. Third, a sequence of bits is shifted into data register. 

At the third stage, a baud rate counter is used to synchronize the proper time of 
bit capture from RXD line. A bit counter stores the number of received bits. A delay 
counter is used to generate small delay after start bit detection to assure proper bit 
capture. A pseudo code for receiver module is given on Fisting 1.2. This algorithm is 
coded in MATFAB language in the Embedded MATFAB function block. 

Transmitter module has two input ports. First is data byte to be transmitted and 
second is signal line to trigger transmission event. The module controls the state of 
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Table 1.4 States of transmitter 


Name 

Size (bit) 

Description 

Data_To 

8 

Data register 

baud_counter 

9 

Baud rate counter 

bit_counter 

4 

Number of sent bits 

txd_last 

1 

Last state of TXD line 

send_en 

2 

Stage of transmission 

Listing 1.3 

Pseudocode for transmitter subsystem 


1 if (send request detected) then 

2 initialize baudrate counter and bit counter; 

3 Data_Reg = Data_To_Send; TXD line is low (start bit); stage = transmit; 

4 elseif (stage = transmit) then 

5 increment baudrate counter; 

6 if (baudrate counter = N_115200) then 

7 TXD line = Data Reg (bit 0); Data Reg = Data Reg shr 1; 

8 increment bit counter; reinitialize baudrate counter; 

9 if (bit counter = 8) then stage = stop bit; TXD line is high (stop bit); end 

10 end 

11 elseif (stage = stop bit) then 

12 increment baudrate counter; if (baudrate counter = N_115200+N_D) then 
14 end 


TXD output line. When a byte is sent a ready signal is generated. Simulink model 
of Transmitter module is analogous to that of receiver module (Figure 1.35). The 
difference is on signal and algorithmic level. Transmitter module has five states 
(Table 1.4). Two of them are for counters. Others are for storage of transmitted byte, 
for storage of TXD line state and for stage of transmission. Transmission is a three- 
stage process. First is an initialization stage of counters and internal shift register. 
Second state is for generation of a start bit. And in the third stage the sequence of bits 
is shifted from data register to the TXD line (Listing 1.3). 

Generation of HDL code from Simulink model is possible only if certain subset 
of supported blocks is used. Embedded MATLAB Function, Unit Delay, Data Type 
Conversion are all supported. For every atomic block in the model there is corre¬ 
sponding section in VHDL file. This allows us to review whether the generated code 
is appropriate or is as expected to be. In our case, we have one main file and two 
subsystems corresponding to Receiver and Transmitter module. Generated VHDL 
code is about 700 lines. 

Unit Delay block is represented in VHDL as a process block which is sensitive to 
clock signal. When clock rise event is detected then the input signal is assigned to the 
state signal. Embedded MATLAB Function block is represented in VHDL as a process 
block with a sensitivity list composed of input ports of Simulink block. Sensitivity 
list of process block contains temporary variables used in MATLAB Function and 
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Table 1.5 Resource utilization 


Parameter name 

Used/Available 

Number of slice flip flops 

56/9,312 

Number of 4 input LUTs 

231/9,312 

Number of occupied slices 

123/4,656 

Number of bounded IOBs 

23/232 

IOB flip flops 

2 


auxiliary variables needed to represent arithmetic and logic operations in HDL. The 
body of process block is translation of algorithm defined in MATLAB Function. 

From generated VHDL code, one builds a Xilinx ISE project file. It contains the 
files corresponding to Simulink model and additional constraint file. UCF Location 
Constraints including I/O pin assignment and the I/O standard used must be specified 
in Xilinx ISE project according to target board documentation. The Xilinx Synthesizer 
generates representation of VHDL code in technological basis of target FPGA device. 
We can see from the reports that Unit Delay blocks are represented by D-Trigger com¬ 
ponents. The algorithm in an Embedded MATLAB Function block is represented by 
combinatorial circuit. It contains elementary logic gates, summator, and comparator 
components. This description can be easily optimized and embedded in FPGA device 
by Xilinx tool chain. Some numerical characteristics of device resource utilization 
are given in Table 1.5. 

Design of the UART controller is validated on several levels corresponding to 
different stages of design process which are: Simulation in Simulink, Behavior sim¬ 
ulation of VHDL code, Experiments. Figures 1.36 and 1.37 represent simulation 
results in Simulink environment for Transmitter module. The purpose of simulation 
is to transmit byte 73 (letter “I”) two consecutive times. To have correct results for 
time scale we set the sample time as T s = 20 ns. 

Experiments are executed by connecting desktop PC to Spartan 3E Starter Kit 
board by RS232 twisted pair cable. From MATLAB environment, we can use serial 
command to open serial communication port. Then by fread and fwrite com¬ 
mands we can receive or send data. We send a sequence of data bytes to FPGA and 
wait to receive the same sequence back. A diagram of experimental setting is in 
Figure 1.33. 

1.8.4 System level development 

According to modular approach, system development is a composition of modules 
interacting through as set of compatible interfaces. Overall system functionality 
results from internal module functionality and module interactions. Hence, system 
level development rather concerns selection of modules and their configuration than 
keeping track of algorithmic control and temporal synchronization which are more 
related to module level development. However, it is not an easy task to choose a system 
configuration with higher performance and lowest cost especially when designing 
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Figure 1.36 Simulation results: (a) logical state of TXD line and (b) state of baud 
rate counter 


Bit counter 
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Figure 1.37 Simulation results: (a) state of bit counter and (b) events of start and 
end of transmission 
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Listing 1.4 System components in VHDL syntax 


architecture Behavioral of ab_contr is 
component gen_tick is 

port (elk : in stdjogic ; clkl : out stdjogic ; clkls : out stdjogic ); 

end component; 

port (elk : in stdjogic ; count : out std logic vector (7 downto 0); 
reset : in stdjogic ; en :in stdjogic ); 

end component; 

signal clklOO,clkl00-90,stop, start , start_reg : stdJogic; 

clockl ; gen-tick port map (elk => elk, clkl => clklOO, clkls => clkl00-90); 

conterl : counter jest port map (elk => clklOO, count => stage, reset => stop, en=> start_reg); 

end Behavioral; 



Figure 1.38 Top view of Spartan 6 FPGA SP601 evaluation board 

ASIC which will be produced in large amount afterwards. Specifying, subsystems in 
VHDL are achieved with component declaration and interconnection between them 
with port map operator (Listing 1.4). 

The modules building complex integrated circuits are called cores. This name is 
given because module printed image on the chip looks like a concentrated struc¬ 
ture with highest density. There are open source cores and proprietary IP cores 
(Figure 1.38). Xilinx Platform Studio (XPS) offers a database of cores for system 
on chip design. Here we give as an example a Microblaze microprocessor system for 
Spartan 6 FPGA of Xilinx on SP601 evaluation board (Figure 1.38). 
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IP Version 

© £ EDK Install 

© Analog 

0 Bus and Bridge 

■ft AXI to AXI Connector 

1.00.a 

ft AXM to AHB-Lite bridge 

l.OO.a 

ft AXM-Liteto APB Bridge 

1.00.a 

ft AXI Interconnect 

1.02.a 

ft AXI to PLBv46 Bridge 

2.00.a 

ft Fast Simplex Link (FSL) Bus 

211 .d 

ft Local Memory Bus (LMB) ID 

2.00.a 

ft Processor Local Bus (PLB) 4.6 

1.05.a 

ft PLBv46 to AXI Bridge 

2.00.a 

ft PLBV46 to PLBV46 Bridge 

1.04.a 


© Clock, Reset and Interrupt 
© Communication High-Speed 
© Communication Low-Speed 
© DMA and Timer 
© Debug 
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© General Purpose 10 
© 10 Modules 

© Interprocessor Communication 

Mailbox l.OO.a 

■ft Mutex 1.00.a 

© Memory and Memory Controller 
© PCI 

© Peripheral Controller 
© Processor 

■ft MicroBlaze 8.10.a 

© Utility 
© Verification 
Project Local PCores 


Figure 1.39 Xilinx IP (intellectual property) cores 


Cores are grouped in categories according to their functions—processor, bus, 
arithmetic, memory, crypto, input/output, and so on. Since the micro system is orga¬ 
nized around buses, these are several supported types in Xilinx like PLB (Processor 
Local Bus), AXI (Advanced extensible Interface), DCR (Device Control Register 
Bus) and Xilinx P2P (Peer to Peer) (Figure 1.39). 

The clock_generator is the source of synchronization signal of the microcon¬ 
troller, dlmb is data local bus, ilmb is instruction local memory bus. Microblaze 
is the only PLB master. There is a separate PLB controller not shown in the 
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SLAVES OF mb_plb 



Figure 1.40 Architecture view of Microblaze FPGA system. Device with 
rectangular port is master and with circular port is slave 
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Figure 1.41 Address mapping of bus devices 


Figure 1.40 which is an interface between the processor and PLB slaves which are 
digital input/output controller (xps_gpio), IC (xps_intc), serial peripheral interface 
controller (xps_spi), universal asynchronous receiver transmitter (xps_uartlite) and 
programmable timer (xps_timer) (Figure 1.41). 
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Listing 1.5 PLB peripheral user logic 


16 

17 

18 

19 

20 
21 
22 


25 

27 

28 

29 

30 

31 

32 


entity user_logic is 

generic 

(C-SLV-DWIDTH : integer := 32; C NUM REG : integer := 1); 

( user specific ports ; plb specific ports ); 
end entity userjogic ; 

architecture IMP of User logic is 

signal slv_reg0 : stdJogic_vector (0 to C_SLVJ3WIDTH— 1); 

signal slv_ip2bus_data : stdJogic_vector (0 to CJSLVJDWIDTH-1); 

begin 

slv rcg write se] <= Bus2IP WrCR(0 to 0); slv reg read sel <= Bus2IP RdCE(0 to 0); 

SLAVE_REG_WRITE_PROC : process! Bus2IP_Clk ) is 

begin 

if Bus2IP_Clk’event and Bus2IP_Clk = ’ 1 ’ then 

slv_reg0 (0 to 7) <= Bus2IP_Data(0 to 7); 

end if; 

end process SLAVE REG WRITE PROC; 

SLAVE_REG_READ_PROC : process! slv_reg_read_sel, slv_reg0 ) is 

end case; 

end process SLAVE REG READ PROC; 

IP2Bus_Data <= slvip2bus_data when slv_read_ack = ’1’ else (others => ’O’); 
IP2Bus_WrAck <= slv_write_ack; IP2Bus_RdAck <= slv_read_ack; 
end IMP; 


There is also an additional debug bus where dedicated debug controller is the 
master and microblaze is single slave device. This configuration allows debug con¬ 
troller to pause (halt) the program execution at a particular point (breakpoint) and 
examine the state of address space (memory and peripherals) as well as internal CPU 
state (registers). Usually, this is necessary when a problematic deviation from normal 
system function is detected and debugging is the processes of identifying the cause. 
Usually debugging module is required only for system development process and not 
in production so this module is removed in production design which saves some space 
on the chip. 

User-defined peripherals are supported when properly connected to Microb¬ 
laze PLB. XPS has a Create Peripheral Wizard for creating necessary wrapping 
VHDL modules. A typical PLB slave peripheral is composed of two subsystems—bus 
attachment and user logic. Bus attachment is responsible to respond to PLB master 
commands and address decoding for user logic registers. User logic implements some 
peripheral-specific function and provides it to the system through a dedicated set of 
registers. Listing 1.5 shows VHDL skeleton of user logic entity with a single register. 
PLB slave interface can select 1 of 4,096 possible internal registers. Bus attachment 
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subsystem provides Bus2IP_WrCE and Bus2IP_RdCE signals for register selection. 
In the example, the single register is internally represented by the signal slv_regO. 
User logic entity contains two process blocks for controlling reading and writing oper¬ 
ations to the internal registers. Write process block takes the data from Bus2IP_Data 
input and puts it in a selected data register synchronously with Bus2IP_Clk signal. 
Read process block activates when register is selected by the slv_reg_read_sel signal. 

1.9 Software configuration 

The software configuration is a kind of virtual stuff emerging from inherent prop¬ 
erties of hardware configuration and from pursuit to increase its quality of service. 
Usually software looks like a diagram or language which is essentially a conceptual 
representation, not a real thing, but always translatable to some material or measur¬ 
able effect. Since embedded control system design requires more interaction with 
software than hardware the section details the steps of development of some basic 
software framework for diverse embedded applications. 

The main driver of textual programing is human ability to interpret symbolically 
presented information. However visual field perception is another ability possibly 
even more powerful that textual comprehension. So there is a natural jump in computer 
software to the level of visual programing languages where one manipulates spatial 
arrangements of graphical and textual symbols. There are many visual program¬ 
ing languages—EICASLAB, Flowcode, Lab VIEW, Ladder logic, Microsoft VPL, 
OpenDX, OpenWire, Blender, Simulink, GNU Radio, PLUS+1 GUIDE, WebML, 
and so on. Visual languages are strongly domain specific and hide lots of hardware 
specific detail (with few exceptions like xUML). They are targeted mostly to applica¬ 
tion design professionals rather than computer programmers. Mapping to hardware 
of visual program is trough process called elaboration meaning that some additional 
information is included to complete the design (Figure 1.42). And so one small graph¬ 
ical diagram can generate a thousands of textual code. In the past, there was some 
skepticism that elaboration can lead to reliable and optimized code as had been the 
case with compilation from C to assembler a few decades earlier. The development 
of validation techniques like PIL for component level and HIL for system level as 
well as introduction of code certification practices can give strong confidence in the 
automatically generated code from visual programs. 

1.9.1 Board support package 

First pieces of software which populate a particular microprocessor architecture are 
low-level device control programs such as clock signal activation, communication 
interface support, peripheral device initialization, boot loading, kernel image load¬ 
ing, etc. This primary tasks are strongly hardware dependent. Structure of program 
algorithm should closely match underlying hardware configuration in order to achieve 
target board support. Target architecture is made of various pieces of hardware which 
require to be accessed by the program in a correct way to be able to fulfill their 
function. Such a programmatic access to system devices supports more complex 




Embedded control systems 55 


Visual language 





Data flow 

UML 

State machine 









Textual language 



Figure 1.42 Code generation hierarchy. UML, unified modeling language; MMU, 
memory management unit 


Listing 1.6 Low-level device control 


1 

interrupt void TIMER JSR(void) { 

2 

unsigned long enc = EQeplRegs.QPOSCNT; 

3 

SciaRegs.SCITXBUF = comm cnt; SciaRegs.SCITXBlIF = enc & OxFF; 

4 

SciaRegs.SCITXBUF = (enc >> 8) & OxFF; SciaRegs.SCITXBUF = (enc >> 16) & OxFF; 

5 

SciaRegs.SCITXBUF = (enc » 24) & OxFF; SciaRegs.SCITXBUF = comm_cnt*10; 

7 

if (commxnt = 16) commxnt = 1; 

8 

PieCtrIRegs.PIEACK.bit.ACKl = 1; } 


software execution. In temporal domain supporting code execution should be fast and 
reliable. 

Listing 1.6 gives an example for low-level timer ISR of TMS320F28335 micro¬ 
controller. A special interrupt keyword instructs the compiler to insert appropriate 
processor context switching code which store processor register state into program 
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stack and after ISR restores state back. This timer ISR sends some data over asyn¬ 
chronous serial line (SCI) by writing bytes to the transmitter FIFO buffer which is 
accessed by an internal register SCITXBUF. The program puts sequentially bytes in 
the FIFO which SCI module sends over the serial line when ready. In listing 1.6 
variable enc is 32 bit long quadrature encoder measurement so it is composed of 
4 bytes. Each byte is taken from enc variable through corresponding bit shift bit 
mask. BSP for the microcontroller includes some helpful definitions like peripheral 
address space representation as C structures, unions, and bitfields. C-bitfields allow 
easy modification of a single bit of a register which is often the case. 

BSP can be either presented as collection of low-level stand-alone driver or as an 
operating system kernel. If designed embedded system has to execute just a few tasks 
then usually stand-alone BSP option is preferred due to smaller size of compiled 
code and simplicity of application development. However when embedded system 
supports a large number of tasks (more than 10 for instance) then operating system 
kernel can considerably reduce development time. 

Stand-alone BSP is simply a collection of software modules supporting user 
program execution through very basic hardware abstraction software. For example, 
a software module encapsulates some of microcontroller peripherals controlled by 
specific set of registers and access protocols. Usage of such kind of lightweight 
software packages can considerably reduce code size and sometimes also development 
time of embedded applications. 

Operating system kernel BSP provide capability for multitasking execution on 
one or several processor cores. Hence the kernel have to regulate the access to 
shared resources by these tasks. The kernel is composed of several kinds of objects: 
tasks, mutex, semaphores, timers, mailboxes, events, and so on. The key algorith¬ 
mic component in kernel is task scheduler which distributes processor execution 
time (runtime) among created tasks considering their priorities. There are couple 
of scheduling algorithms most commonly used—round robin and priority based. In 
real-time applications with limited processor resources good scheduling depend on 
number of tasks. 

1.9.2 Application programing interface 

Interface works like an imaginary border where application can access provided func¬ 
tionality by the underlying system. In programing, an interface is a set of callable 
functions and data structures which act as an isolation between implementation and 
usage. There are many instances of programing interfaces for purposes like device 
control (GDI, OpenGL, device drivers) or inter process communication (TAPI, file 
access). In order to use particular API the user have to be familiar with its data struc¬ 
tures, functions, and concept of operation. For example, Table 1.6 shows how typical 
file access is organized. 

1.9.3 Code generation 

Traditionally simulation models arise as a means for understanding logical relations 
in the system under study or design. Often the model can replace the actual system 
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Table 1.6 API organization of file access 


Data structures 

Functions 

Concept of operation 

File handle, file name, 

Open or close file 

File is linear byte 

access mode (read/write) 


indexed space like 
a tape, identified 
by handle number 

Buffer, operation size 

Write or read data 

Buffers of data are 
sequentially written 

File position 

Seek 

There is a current file 
position changed by 
data transfer 



Figure 1.43 General concept of software design flow 


to make conclusions about its behavior under extreme conditions. In the recent years, 
simulation models are used also as an executable specification becoming a functional 
part of the design process. Therefore, the model can produce not only conclusions 
about some extreme scenario but also can directly generate some part of an actual 
system behavior. 

The general concept of software design flow is shown in Figure 1.43 and the code 
generation in Simulink is represented in Figure 1.44. 
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Figure 1.44 Code generation in Simulink 

Simulink Coder generates C and C++ code from Simulink diagrams, Stateflow 
charts, and MATLAB functions. The generated source code can be used for real-time 
and non-real-time applications such as simulation acceleration, rapid prototyping, 
HIL simulation, embedded algorithm design, and so on. 

Math Works® documentation discuss in details the translation of a Simulink model 
into suitable description for target hardware platform [9], This process generates a 
sequence of intermediate representations of the primary Simulink functional view. 
A key transition is the one from mathematical expressions to C formal language. 
Consequently generated code is integrated with additional device drive libraries and 
compiled to stand alone executable. Alternatively, one can integrate generated code 
with application interface calls and create an application for real-time operating sys¬ 
tem. The process finishes with compilation and loading into target microcontroller. 
These transformations of the original functional descriptions are required because 
Simulink model is more abstract form of representation than target hardware resources 
can handle. Code generation is controlled through template-like configuration files. 

In the following points are summarized some general properties of above 
components: 

• Target language compiler (TLC). TLC is an intermediate script language repre¬ 
senting the transition from Simulink graphical blocks to the target code. Usually 
each Simulink block has a corresponding TLC file. When S-function block is 
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used the designer has to specify also its TLC description in order to inline the 
block into target software. TLC parser can read generated rtw file from the 
Simulink model. The parser also can access block input and output signals which 
are necessary to properly reproduce block function in C language. 

• System target file (STF). This is the main TLC file which is read when Build 
Command is executed. It calls the rest of block specific TLC files. The STF 
also defines some target specific interface for user interaction through Model 
Configuration Settings. For example one can turn on or off a particular software 
future in the generated code. 

• Template make file (TMF). In a standard compiler toolchain one can control the 
whole process of compilation and linking with a huge set of options through 
a dedicated compiler and linker switches. The various switches for a particular 
project are integrated in a single makefile which specify how the whole project is 
build. The makefile is fed into a make tool which in turn invokes other programs 
from the toolchain. TMF is a template for makefile generation for a particular 
Simulink model. It is like a makefile with a lot of placeholders for model specific 
names and user settings. 

• Hook files. The build process is guided by the make_rtw program. It is the entry 
point for code generation. The hook files allow the user to interact with code 
generation process for example to setup some include and source file directories. 

• rtwfile. This file contains a representation of the Simulink model as a hierarchical 
record structure including all block interconnections and parameters. This is the 
form which TLC parser can read in order to produce C programs. 

• Target Simulink library. Each target defines its specific blocks for device drivers 
or other platform dependent resources. 

Programing of embedded control systems is commonly based on C programing 
language. However, some RTL functionality is still programmed in lower level lan¬ 
guage, i.e., target assembler. The compilation and linking programs are essential for 
generation of executable code for a target hardware platform. 

First, the compilation program transforms C program to a corresponding 
object code which is program representation with hardware dependent instructions 
(Figure 1.43). The object file contains also a symbolic table for declared identifiers by 
the program. The symbolic table allows address independent program representation 
which is necessary to generate relocatable and modular programs. Second, the link¬ 
ing program combines all modular object file and other static libraries into a single 
relocatable file. In this form, the program is a set of memory sections which can be 
mapped to the target physical address space by the loader program (Figure 1.45). 

Common practice is programing in native target language (assembler) to be as 
little as possible because of portability issues. However, knowledge of target assembler 
is required in certain situations—hardware initialization, memory usage or execution 
speed optimization, debugging on instruction basis. 

The interface between platform specific software and Simulink model is based 
on custom developed blocks (S-function driver blocks). They support separate 
representation for simulation and implementation. Usually during simulation, these 
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Relocatable file 


Executable file 


Hardware platfrom 


Application model 


Operating system 



Figure 1.45 Simulink Coder TMF infrastructure 



driver blocks have only structure presence in diagram sourcing and sinking dummy 
signals. However during code generation, driver blocks TLC script can access con¬ 
nected signals and other block parameters with the aim to produce required C program 
for the block (Figure 1.46). 

1.9.4 Code validation 

There exists some helpful validation techniques which are used frequently with 
automatic code generation. The purpose of code validation is to experiment with auto¬ 
matically generated program in hardware or in cycle-accurate simulator. The problem 
is that in visual programing, the same task can be achieved in many different manners 
which are equivalent on visual level but not on a textual or machine level. Therefore, 
if one doesn’t understands the internal mechanism of code generation process, there 
is a high risk to produce a nonoptimal or nonreliable solution. For this reason, code 
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validation have an important place before actual experimental work with the plant to 
begin. 

Many of the problems in a system under design can be found trough precise 
numerical simulation which accounts for target hardware specifics. In cycle-accurate 
simulation, timing of events is precise but there is no need the simulation to use exact 
hardware models. 

Replacing a physical system like a vehicle, plane, or robot with a real-time sim¬ 
ulation of a virtual system drastically reduces the cost of testing control software and 
hardware. The corresponding methodology is called HIL simulation. HIL designer 
decides which subsystems to be implemented as hardware and which as simulations. 
Hardware implementation in the early project phases could bring some considerable 
risk or unpredictable costs. Simulations are safe to execute and easy to handle but to 
be useful require extensive experimental knowledge and consequent verification and 
validation procedures. In the field of control usually the plant is simulated the con¬ 
troller is in hardware so HIL simulation decisions are straightforward. Still appropriate 
interface points and interconnections should be established. 

Usually hardware implementation of the controller doesn’t cause large variations 
from host-simulated controller except for some critical conditions caused by limited 
platform resources. However under HIL simulation generated control signal u hi i is 
more or less different from non-HIL simulated u sim so 

Una = u sim + ui,w ( 1 - 6 ) 

where u hw reflects several hardware-dependent effects which are summarized in the 
following points: 

• Target hardware may use different finite precision arithmetic (fixed or floating¬ 
point) than host model for representation of numbers and arithmetic operations. 
This causes rounding errors subject to numerical analysis. 

• Communication between host and the target can experience uncertain trans¬ 
port delays caused by loss of data during transmission related to line collision 
conditions, electromagnetism noise sources or protocol negotiations. 

• Reaction of real-time system to external events is temporally deterministic but still 
variable in some interval. This reflects as slight deviations in defined by designer 
sample times which can be represented as impulse-like input disturbance acting 
upon continuous plant model. 


1.10 Notes and references 

Important aspects of embedded control system design are considered in Hristu- 
Varsakelis and Levine [10], Marwedel [11], Popovici et al. [12], Westcot [13], Basten 
et al. [14], Ledin [15], Lozzano [16], A good overview of the design process is 
presented in Forrai [17], 
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A variety of sensors and actuators is described in detail in Fraden [18], Anj anappa 
et al. [2, Chapter 17], Braunl [19, Chapters 3 and 4], and Isermann [20, Chapters 9 
and 10]. 

The theory of digital control systems is presented in depth in Astrom and 
Wittenmark [21]; Landau and Zito [4]; Franklin, Powell, and Workman [8]; Isermann 
[22,23]; Fadali and Visioli [24]; and Houpis and Lamont [25], For good introduc¬ 
tions to this subject, see Santina and Stubberud [26, Chapters 10, 12, and 13] and 
Wittenmark, Astrom and Arzen [3], The book of Pelgrom [27] is entirely devoted 
to ADC. 

The computer arithmetic and floating point computations are described in Higham 
[7, Chapter 2], Moler [28], Muller etal. [29], Koren [30], Laub [31], and Overton [32], 

The techniques of control prototyping and FIIL simulation are discussed in Iser- 
man [20, Chapter 12], [33], [2, Chapter 2] andForrai [17, Chapter 8], More on HIL and 
PIL simulations may be found in the user guide of Embedded Coder [34, Chapter 36], 

Different aspects of hardware and software configuration of embedded systems 
are presented in depth in Flardin [35], Marwedel and Goossens [36], Mogensen [37], 
Noergaard [38], and Pedroni [39]. The development of embedded systems with FPGA 
is considered in Dubey [40], Kilts [41], and Sass and Schmidt [42], 



Chapter 2 

System modeling 


This chapter is devoted to the mathematical description of the basic elements and 
processes pertaining to the embedded control systems. The models obtained as a result 
of this description are important for the design of controllers which have to ensure 
the necessary performance and robustness of the closed-loop system. The main point 
of the chapter is the derivation of adequate continuous-time and discrete-time models 
of the plant, sensors, and actuators. For this aim, we implement various analytic and 
numeric tools available in control theory and control engineering practice. These tools 
include modeling, linearization, and discretization of dynamic plants, system iden¬ 
tification, modeling of uncertain systems, and stochastic modeling. We demonstrate 
the usage of different MATLAB® functions and Simulink® blocks intended to build 
accurate and reliable models of embedded system components. 


2.1 Plant modeling 

An important stage in building the system model is the control plant modeling. In 
the general case, the plant is a nonlinear multiple-input-multiple-output (multivari¬ 
able) high-order dynamic system whose properties to a large extent determine the 
performance which may be achieved by the closed-loop system. In some cases, the 
plant involves processes described by partial differential equations, like gas and liq¬ 
uid flows, combustion processes, and so on, which for the design purposes should be 
approximated by low-order models described by ordinary differential equations. The 
plant modeling is thus a trade-off between the accuracy of dynamics approximation 
and the complexity of model obtained. 

There is a variety of techniques used in the modeling of control plants which 
lead to different mathematical models. In the relatively simple cases, it is possible to 
derive analytic models implementing the laws (or principles) of physics, chemistry, 
biology, economics, and so on. Such models are convenient to use but frequently do not 
embrace the whole complexity of the processes under control. That is why, these mod¬ 
els are added with blocks whose input-output behavior is determined experimentally 
or by using some identification method applied on the experimental data. In such case, 
one says that a numeric model is derived to distinguish it from the analytic models. 

The mathematical description of plant dynamics can be obtained in the form of 
differential and algebraic equations, transient and frequency responses, tabular data, 
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and so on. For the purpose of system analysis and design, we need a plant model in 
the form of linear state-space model or transfer function matrix. Such description is 
convenient to obtain by using the capabilities of MATLAB and Simulink which are 
suitable to determine high-order models. 

Usually, the plant modeling is a difficult process which is performed in an iterative 
way. The systematic presentation of this process is out of the scope of this book and 
we refer the reader to the literature given at the end of this chapter, where the modeling 
techniques are described in sufficient details. In this section, we shall assume that 
the basic mathematical description of the plant in the form of (non)linear differential 
and algebraic equations is already available and it is necessary to find a linear plant 
model in the form of state-space equations or transfer function matrix. This leads to 
the necessity of linearizing the plant dynamics in the vicinity of an equilibrium state 
and subsequent discretization of the plant model for given sampling frequency used 
in the real time control system. 

Example 2.1. Cart-pendulum system 

Several embedded control problems considered in this book will be illustrated by the 
cart-pendulum system, used as a laboratory set-up in many universities. The system 
is shown schematically in Figure 2.1. It consists of an inverted pendulum with mass m 
(assumed concentrated at the tip) which is balanced in upright position by moving the 
cart on a rail in appropriate direction. The control problem is to stabilize the pendulum 
around the vertical axis keeping at the same time the cart at reference position. As we 
will see latter on, this system has some peculiarities which makes its stabilization a 
difficult control problem. 

To find the mathematical description of the cart-pendulum system it is appropri¬ 
ate to use the Newton-Euler dynamics. For this aim, we introduce as state variables 
the cart position p and cart velocity p, the pendulum angle 0 and pendulum angular 
rate 0. The force applied at the base of the system is denoted by F, and it is aligned 



Figure 2.1 Cart-pendulum system 
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with p in the horizontal direction. Further on, we shall assume that this force is pro¬ 
duced by the aid of a DC motor with pulse-width modulated (PWM) input signal u 
so that F = k F u, where k F is a constant parameter. As system outputs, we consider 
the cart position and pendulum angle. The system is described by two second-order 
nonlinear differential equations in the form 

T M + m — w/cos^lTpl [f c p + ml sin 99 2 1 ["^mI 

^ —ml cos 9 I + ml 2 J |_ ^ J f P 0 — mgl sin 9 J 0 J 

where M is the cart mass, / is the moment of inertia of the system to be balanced, 
/ is the distance from the base to the center of mass of the balanced body, f c and 
f p are coefficients of viscous friction related to the motion of cart and pendulum, 
respectively, and g is the acceleration of gravity. 

In Table 2.1, we give the nominal parameters of a real cart-pendulum system 
which are used in the subsequent analysis and design of the system. 

Let us introduce the state vector as x — \p, 9, p, 6] T and the output vector as 
y =\p 9] t . Defining the total mass as M, = M + m and the total moment of inertia 
as I t = I + ml 2 , (2.1) is represented as 


P 


d 9 


dt 


. 9 


P 


—mll t sg9 2 + m 2 l 2 gS0Cg — I,f c p — f p mlc„0 + I t k F u 
M,I, - m 2 l 2 c e 

— m 2 l 2 s s cgd 2 + M,mgls e —f c mlc e p —f p M t 9 + mlc e k F u 
M t I t — m 2 l 2 Cg 


where s e stands for sin (0) and c e stands for cos (9). 

The nonlinear cart-pendulum model (2.2) is implemented by the Simulink model 
pendulum_cart.six. 


Table 2.1 Cart-pendulum nominal model parameters 


Parameter 

Description 

Value 

Units 

m 

Equivalent pendulum mass 

0.104 

kg 

M 

Equivalent cart mass 

0.768 

kg 

l 

Distance from the base to the 
system center of mass 

0.174 

m 

I 

Pendulum moment of inertia 

2.83 x 10- 3 

kg m 2 

fc 

Dynamic cart friction coefficient 

0.5 

N s/m 

fp 

Rotational friction coefficient 

6.65 x 10~ 5 

N ms/rad 

k F 

Control force to PWM signal ratio 

9.4 

N 



66 Design of embedded robust control systems using MA TLA B'-VSimulin/c' 


Equation (2.2) can be written in the general form 

jx(t) =f{x,u), 
y(t) = h(x,u) 


(2.3) 


where x(t) is the state, u(t) is the control, and y{t) is the output. 

Equation (2.3) represents the nonlinear plant model. This model is used to obtain 
a linearized plant model and is implemented in the nonlinear simulation of the closed- 
loop system. □ 


2.2 Linearization 


MATLAB files used in this section 

File 

Description 

1inearize_pendulum_cart 
transfer_functions 
pendulum_cart.six 

Linearization of the cart-pendulum system 
Transfer functions of the cart-pendulum system 
Simulink model of the cart-pendulum system 


To linearize the nonlinear plant (2.3), it is possible to implement different tech¬ 
niques. In this section, we shall describe three methods which will be provisionally 
named as analytic, symbolic, and numeric linearization. 


2.2.1 Analytic linearization 

The analytic linearization aims to obtain linear plant equations by using the analytic 
plant model (2.3). In this case, the plant dynamics is approximated by linear differen¬ 
tial and algebraic equations in the vicinity of an equilibrium point x,,, u e characterized 
by the condition x =f(x, u) = 0. This is done by expanding the nonlinear functions 
/ and h in Taylor series in respect to the vectors Ax = x — x e , Au = u — u e and 
A y = y — y e . Since the deviations from the equilibrium state are assumed small, the 
quadratic and higher order terms in Ax, A u, and Ay can be neglected. As a result one 
obtains the linearized state equation 

jAx{t) = AAx + BAu, (24) 

A y(t) = CAx + DAu 

where A, B, C, D are matrices with corresponding dimensions. These matrices are 
obtained as partial derivatives (Jacobian matrices) of the vector-functions/ and h in 
respect to the arguments x and u, evaluated at the equilibrium (trim) values x e , u e as 



, B=V 

, C=“ , 



3 U *=*e 

dx 

3 u 
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The trim values are obtained as a solution of the nonlinear algebraic equation 
f(x e ,u e )= 0 and may be nonunique. In the case of time-invariant models, the matrices 
A, B, C, D have constant elements. Further on the symbol A will be dropped out to 
simplify notation and instead of (2.4), we shall use the equation 


jx{t) = Ax-V Bu, 
y(t) = Cx + Du. 


(2.5) 


However, the reader should always bear in mind that x,y, u involved in this equation 
are actually the deviations of the corresponding variables from their trim values. 


Example 2.2. Analytic linearization of cart-pendulum system 

Consider the linearization of the model (2.3) for small deviations of the pendulum 
angle around zero. The equilibrium state in the given case corresponds to the straight- 
up position= [0, 0, 0, 0] r . (Note that this equilibrium state is unstable.) Taking 
into account that for small 9 it is fulfilled that sin ( 6 ) ~ 9, cos ( 0 ) ~ 1 and 0 2 ~ 0 we 
obtain the linearized model 

jx(t) = Ax(t) + Bu(t), 

y{t) = Cx(t ) 


where 

x(t) = [p0p Of, y(t) = \p 0] T . 
and 

‘0 0 1 0 
0 0 0 1 
'' “ 0 mH'g/T) -U/r, —fplm/r) 

_ 0 M t mgl/r) —f c ml/r) -f p M t /r) 

" 0 
0 

B = k F 

ith 
Jm/r) 

rj = M,I t — m 2 l 2 , I, = I + ml 2 . 



Note that in the given case 



The presence of a zero column of matrix A prompts that there is an integrator in the 
plant. 
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For the nominal parameters of the cart-pendulum system, one obtains the 
matrices (up to four decimal digits) 

1 0 

0 1 

-6.1182x10-' -2.4629 xl0“ 4 ’ 

-1.8518x10° -1.1868 x 10- 2 . 

c=r iooo i. 

|_0 1 0 oj 

The plant is completely controllable and completely observable. Its poles, found 
by the function pole, are 

pi =0, p 2 = 5.6054, pi = -5.6561, p 4 = -0.5730 
which confirms that there is a zero pole corresponding to an integrator. □ 

The analytic linearization has the advantage that the linear model (2.5) can be 
obtained so that the elements of matrices A, B, C, D depend explicitly on plant param¬ 
eters. This is important in deriving uncertain plant models in which the parameters 
vary around their nominal values. The drawback of this linearization method is that 
its implementation by hand is difficult in case of high-order systems and may be 
associated with errors. 

2.2.2 Symbolic linearization 

The symbolic linearization is a kind of analytic linearization performed by using 
the Symbolic Math Toolbox™ of MATLAB. The functions of this toolbox allow to 
manipulate analytically complicated expressions arising in the derivation of nonlinear 
plant models and to evaluate the Jacobian matrices participating in the linearized 
models. This makes possible to obtain error free expressions for the linearized models 
of high-order systems. 

Example 2.3. Symbolic linearization of cart-pendulum system 

To find the matrices A, B, C,D of the linearized cart-pendulum system, one should 
first enter in symbolic form the nonlinear model (2.1). This can be done by the 
command lines 

syms p p_dot theta theta_dot u 
syms m g 1 I_t M_t f_c f_p k_F 

M_q = [M_t -m*l*cos(theta) 

-m*l*cos(theta) I_t] 

C_q = [f_c*p_dot+m*l*sin(theta) *theta_dot''2-k_F*u 
f_p*theta_dot-m*g*l*sin(theta)] 


■0 0 

0 0 

0 6.5748 X 10-' 
.0 3.1682 x 10' 

0 

0 

1.5736 x 10' ’ 

.4.7629 x 10'. 
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The nonlinear expressions for the variables p, 0 are found easily by using the 
single command 
f = -inv(M_q)* C_q 

which inverts symbolically the matrix M q . Then, the Jacobian matrices are computed 
by the lines 

d_p = p_dot; 
d_theta = theta_dot; 
d_p_dot = f(1); 
d_theta_dot = f(2); 

F_x = jacobian([d_p; d_theta; d_p_dot; d_theta_dot], ... 

[p theta p_dot theta_dot]) 

F_u = jacobian][d_p; d_theta; d_p_dot; d_theta_dot], [u]) 

H_x = jacobian([p; theta], [p theta p_dot theta_dot]) 

H_u = jacobian([p; theta], [u]) 

Setting the trim conditions as 

theta_trim = 0; 
p_dot_trim = 0; 
theta_dot_trim = 0; 


the symbolic expressions for the matrices of the linearized model are found by the 
lines 

F_x = subs(F_x,{p,theta,p_dot,theta_dot,u}, ... 

{p_trim,theta_trim,p_dot_trim,theta_dot_trim,u_trim}) 
F_u = subs(F_u,{p,theta,p_dot,theta_dot,u}, ... 

{p_trim,theta_trim,p_dot_trim,theta_dot_trim,u_trim}) 
H_x = subs(H_x,{p,theta,p_dot,theta_dot,u}, ... 

{p_trim,theta_trim,p_dot_trim,theta_dot_trim,u_trim}) 
H_u = subs(H_u,{p,theta,p_dot,theta_dot,u}, ... 

{p_trim,theta_trim,p_dot_trim,theta_dot_trim,u_trim}) 

As a result, we obtain expressions for the elements of matrices A, B, C, D as 
explicit functions of the plant parameters. Numerical values of these matrices may be 
found by substituting the plant parameters by their numerical values in the derived 
expressions for F x , F y , H x , H„. □ 

The using of symbolic computations is also convenient in determining the plant 
transfer functions. To find the transfer functions between the plant input u and the 
outputs p and 9, one may solve symbolically the linear system of equations 


Mf = q 


in respect to/ where 


' r)s 2 +f c I,s 

f p mls — m 2 l 2 g 


f c mls 

rjs 2 + f p M,s — M t mgl ’ 

q ~ [ mlk F. 


M = 
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As a result, one obtains the transfer functions 


G pu (s) - k F - 


7 (MJ, - m 2 l 2 )s 4 + (M t f p +I,f c )s 3 + (fjp - M,mgl)s 2 -fmgls 


I,s 2 +f p s-m g l 


and 


Gg u (s) = k F - 


mis 


' (. M t I, - m 2 l 2 )s 3 + (MJ p + I t f c )s 2 + (fcfp - M t mgl)s -frngl 


Note that due to cancelation between zero and pole in the nominator and denom¬ 
inator of the transfer function Gg u , the order of this function is equal to three, while 
the order of G pu is four. This cancelation does not affect the system controllability 
and observability because it takes place only in the transfer function G Su . Using the 
nominal plant parameters, one obtains that 


15.74s 2 + 0.175s — 467.2 


g pM ^ + 0 62375 3 _ 31 . 68*2 _ 18 17 *’ 


G9u{S) s 3 + 0.6237s 2 - 31.68s - 18.17 


The transfer function G pu has zeros at 
z t = -5.45463, z 2 = 5.4435 

and Gq u has one zero at 0. The plant is nonminimum phase. 

The block diagram of cart-pendulum system is represented in Figure 2.2. The 
system is described by the equation 

y(s) = G(s)u(s) 


where 



Note that G(s) is a 2 x 1 (rectangular) transfer function matrix so that the frequency 
response G(Jco) has only one singular value. This means that the closed-loop system 
may track only one reference and in the given case this is the cart position. The 
pendulum can only be stabilized around the vertical position. 



G 


Figure 2.2 Bloch diagram of cart-pendulum system 
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The symbolic linearization is recommended for using in all cases when an analytic 
nonlinear plant model is available. 

2.2.3 Numeric linearization 

A linearized model of the nonlinear plant (2.2) can be determined by using a 
Simulink model of the plant and implementing the functions trim and linmod. 
The purpose of the function trim is to find the state x e and the control u e corre¬ 
sponding to the equilibrium point of the system. It also gives information about the 
value of the state derivative at equilibrium point which should be theoretically equal to 
zero, trim has several options allowing to satisfy input, output, and state constraints. 
Using the information obtained by trim, the function 1 inmod determines the matri¬ 
ces of the plant model linearized at equilibrium point. Note that the linearized model 
may have a state vector which differs from the state vector of the analytic model. This 
will affect the matrices of the linearized model but will not affect the input-output 
properties of the model. 

Example 2.4. Numeric linearization of cart-pendulum system 

The numeric linearization of cart-pendulum system utilizes the nonlinear plant model 
pendulum_cart. six and is done by the command lines 

xO = [0000]'; 
uO = 0; 

[x,u,y,dx] = trim('pendulum_cart',xO,u0,[],[],[],[]) 

[a,b,c,d] = linmod('pendulum_cart',x,u); 

G_num = ss(a,b,c,d); 

The state-space model of the linearized plant is obtained in the variable G_num. 
The elements of matrices a, b, c, d obtained by this linearization method coincide with 
the corresponding elements of the matrices A, B, C, D found by analytic linearization 
at least to then decimal digits and the vector dx is exactly zero vector. □ 

It is interesting to compare the three linearized models of the cart-pendulum 
system derived in Examples 2.2-2.4. 

In Figures 2.3 and 2.4, we compare the Bode plots of analytic, symbolic, and 
numeric models for the nominal parameters with outputs cart position p and pendulum 
angle 0, respectively. The three models practically coincide. 

2.3 Discretization 


MATLAB files used in this section 


File 


Description 


discrete_f req_response Discrete-time frequency responses 

discretization_pendulum_cart Comparison of different 
discretization methods 

discrete_transfer_functions Discrete-time transfer functions 

of cart-pendulum system 
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Frequency response from u to p 



Frequency response from u to 0 



Figure 2.4 Bode plot of the linearized models with output 0 
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2.3.1 Discrete-time models 

A discrete-time control system may be described by different mathematical models. 
In the simple case of a linear discrete-time system with scalar input u(k ) and scalar 
output y(k), it is possible to use input-output relation in the form of nth order difference 
equation 

y(k + n) + aiy(k + n - 1) H-f a„y(k) = b 0 u(k + m )-1-f b m u(k) (2.6) 

where n>m. 

In the analysis of the system (2.6), it is convenient to use the so-called forward 
shift operator q defined by 
qf(k)=f(k + 1) 

Multiplying a time-sequence by the operator q implies that the sequence is shifted 
one step ahead. Multiplying with q' implies a shift of i steps forward. In the same way, 
multiplying with q~' means a backward shift of i steps. The operator q~ l is called the 
backward shift operator. 

In terms of the forward shift operator, the model (2.6) becomes 

q"y{k) + aiq n ~ l y(k) -\ -f a„y(k) = b 0 q n u(k) -\ -f b m u(k) (2.7) 

or 

y(k)0t^(k) ( 2 . 8 ) 

Md) 

where the polynomials A q (q) and B q (q) are defined as 
M 7) = <?" + aiq"~ l + ••• + «*, 

Bqikl) = boq m + b\q m 1 + • ■ ■ + b m 

Taking Z-transform on each side of (2.7) and assuming zero initial conditions, 
one obtains that 


A q (z)Y(z) = B q (z)U(z) (2.9) 

where Y(z), U(z) are the Z-transforms of the sequences y(k) and z(k ), respectively, 
and 

4 q (z) = z” + a\z n 1 + • • • + a„, 

Bq(q) = b 0 z m + b\z m 1 + • • • + b m 
Equation (2.9) can be rewritten as 


Y(z) = G(z)U(z) 


G(z) = - 


( 2 . 11 ) 


is called the discrete transfer function of the system (2.9). As in the continuous¬ 
time case, the transfer function uniquely determines the input-output behavior at the 



74 Design of embedded robust control systems using MATLAB® /Simulink ® 


discrete sampling times for zero initial conditions. The roots of A q (z) = 0 are the 
poles and the roots of B q (z) = 0 are the zeros of the system. Stability of the system 
then requires that all the poles should be strictly inside the unit circle. 

In several cases instead of the model (2.6), it is preferable to use a state-space 


description in the form 

x(k + 1) = Ax(k) + Bu(k), (2.12) 

y(k) = Cx(k) + Du(k) (2.13) 

where x(k), u(k), and y(k) are the state, input, and output sequences, respectively, and 
A, B, C, D are matrices with appropriate dimensions. 

Using the forward shift operator in (2.12) gives 

qx(k ) = Ax(k) + Bu(k), (2.14) 

y(k) = Cx(k) + Du(k) (2.15) 

Taking Z-transforms in (2.14), (2.15) for zero initial conditions yields 
Y(z) = G(z)U(z) (2.16) 

where 

G(z) = C(zl - A)~'B + D (2.17) 


The role of discrete transfer functions (2.16) and (2.17) in describing the dynamic 
behavior of linear systems parallels that of transfer functions for continuous-time 
systems. 

2.3.2 Discrete-time frequency responses 

Consider a single-input-single-output discrete-time system described by the transfer 
function G(z). Assume that the input u(k) of the system is obtained by sampling with 
period T s of the continuous-time sinusoidal signal 

u(t) = sin (cot) (2.18) 

Replacing t by kT s , we see that the input to the discrete-time system is a sinusoidal 
sequence of the form 

u(k) = sin (£2k) (2.19) 

where Q = coT s . Then, it is possible to show that the forced system output y(k) is 
another sinusoidal sequence with the same frequency of the form 

y(k) = M(Q) sin (£2k + (j>) (2.20) 

where 

G(e ja ) = M(Q)e Ma) (2.21) 

Hence, the frequency response plots of a discrete-time system are plots of the 
magnitude M(Q) and the phase 4>(Q) of the discrete-time transfer function evaluated 
at z = e jQ . These plots are periodic, because e jQ is periodic in Q with period 2tt . 
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Frequency (rad/s) 

Figure 2.5 Periodicity of the frequency response of a discrete-time system 


Since the frequency responses are symmetric about £1 = n , the frequency range of £2 
from 0 to ?r is sufficient to completely specify the frequency response of a discrete¬ 
time system. Therefore, the frequency response is completely specified if w = Sl/T s 
varies in the range from 0 to n / T s = co N where co N = co s /2 is the Nyquist frequency. 


Example 2.5. Periodic behavior of discrete-time frequency responses 

The periodic behavior of the discrete-time frequency responses is illustrated in 
Figure 2.5 which shows the magnitude and phase responses of a first-order lag 


G(s) = 


0.5 

0.25s + 1 


whose input is sampled with period % = 0.04 s, the output being reconstructed by 
using zero-order hold. The corresponding discrete-time transfer function is (to six 
digits) 


= 0.739281 

{ZJ z - 0.852144 

The Bode diagram of the discrete-time system obtained for frequencies in the 
range [0.1, co N = 78.5398] is shown in Figure 2.6. □ 
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Bode diagram 



2.3.3 Discretization of continuous-time models 

After finding a linearized description of a nonlinear plant, the next step is to determine 
a discrete-time linearized model for a given sampling period T s . This model is used 
in the design of a discrete-time controller which is implemented in the embedded 
control system or in the hardware-in-the-loop simulation of the closed-loop system. 

The discrete-time equivalent of the continuous-time model (2.5) has the form 

x(k + 1) = A d x(k) + B d u(k), 
y(k) = C d x(k)+D d u(k ) 

where x(k), u(k), y(k) are the state vector, control vector, and output vector, respec¬ 
tively, at the sampling instant kT s and A d , B d , C d , D d are matrices with appropriate 
dimensions. These matrices are determined from the corresponding matrices of the 
continuous-time model (2.5) and depend on the sampling period T s and the imple¬ 
mented discretization method. Systematic presentation of discretization methods for 
continuous-time models may be found in the references given in the end of this 
chapter. In this book, we shall make use of the zero-order hold discretization method 
(Figure 2.7) which produces a discrete-time model with matrices 

A d = e ATs , B d = f S ef a doB, C d = C, D d = D. 

Jo 

This method is characterized by the fact that the pole p of the continuous-time 
model is mapped into the pole e pT ' of the discretized model. 
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Figure 2 .7 Discretization of a continuous-time plant 


It is possible to show that the matrices A d and B d of the discrete-time model may 
be found by computing a matrix exponential. Let 



is a block (n + m) x (n + m) matrix. Then 
\A d B d l z 

L° 4 J =e - 

The derivation of discrete-time model of a nonlinear plant may be done in 
MATLAB in two ways. The first opportunity is to discretize the continuous-time 
linear model obtained by some of the linearization methods, considered in the pre¬ 
vious section. This can be done by using the function c2d. The second opportunity 
is to use the function dlinmod which derives directly the linearized discrete-time 
model from the continuous-time nonlinear plant model. Both opportunities will be 
considered briefly below. 

The function c 2 d has an option to implement five discretization methods, namely, 


Method Description 

‘zoh’ Zero-order hold on the inputs (default method) 

‘foh’ First-order hold (linear interpolation of inputs) 

‘impulse’ Impulse-invariant discretization 

‘tustin’ Bilinear (Tustin) approximation 

‘matched’ Matched pole-zero method (for SISO systems only) 


Example 2.6. Discretization of cart-pendulum system 

Given the nominal continuous-time linearized model of the cart-pendulum system, 
derived in Example 2.2, the discrete-time model for sampling interval T s = 0.01 s is 
obtained as 

[Ad,Bd] = c2d(A,B,Ts) 

The discrete-time model has a state vector 


m = [ P {k ) e(k)p(k) e(k)\ 
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and matrices 

P 1 3.2815 x 10 -4 9.9695 x 10“ 3 9.7135 x 10“ 8 ' 

0 1.0016x10° -9.2424 xlO“ 5 1.0005 x 10“ 2 

d ~ 0 6.5578 x 10 -3 9.9390 x KT 1 3.0358 x 1(T 5 ’ 

_0 3.1691 x lO” 1 -1.8470 x 10~ 2 1.0015 x 10° _ 

7.8521 x 10“ 4 
2.3771 x 10“ 3 
1.5689 x lO” 1 
4.7506 x lO” 1 

The discrete-time transfer functions in respect to p and 6 are determined from 
the discrete-time state-space model by using the function tf. As a result, one obtains 
0.0007852z 3 — 0.000789 lz 2 — 0.0007843z + 0.0007835 
pu ^ ~~ z 4 - 3.997z 3 + 5.988z 2 - 3.984z + 0.9938 ’ 

0.002377z 2 - 4.938e - 06z - 0.002372 
0u ^ Z) ~ z 3 - 2.997z 2 + 2.991z - 0.9938 ’ 

respectively. 

The zeros of H pu are 

z, = -0.99796, z 2 = 1.05594, z 3 = 0.94691 
and the zeros of H eu are 

z* = 1.0, z 2 = -0.99792. 

Note that these transfer functions have n — I zeros, where n is the order of the 
corresponding transfer function. This is a common property of the discretized models 
with zero order hold method [43, Section 13.3]. □ 

In what follows we compare the properties of the discretization methods imple¬ 
menting zero-order hold, first-order hold, and Tustin approximation, respectively. 
Using the continuous-time model of the cart-pendulum system in respect to the 
output p, the function c2d produces three different discrete-time models using the 
methods “zoh”, “foh”, and “tustin”. 

The magnitude and phase plots of the discretized models are compared in 
Figures 2.8 and 2.9, respectively. As it is seen from the figures, the Tustin and 
zero-order hold method tend to produce large magnitude errors near to the Nyquist 
frequency while the zero-order hold method introduces large phase lag in the same 
frequency region. These approximation errors may be reduced to some extent by 
increasing the sampling frequency. Independently on the relatively worse properties 
of the zero-order hold method it is widely used in practice due to the simplicity of 
sampling and hold technical implementation. Note that the method “tustin” may be 
used in conjunction with frequency prewarping which allows to remove the frequency 
distortion at a specific frequency, see for details [3, Section 6], 

As noted previously, a discrete-time plant model may be derived directly from 
the continuous-time nonlinear model by using the function dlinmod which is a 
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Figure 2.8 Magnitude plots of discretized models 
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Figure 2.9 Phase plots of discretized models 
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Bode plots of discretized plants 



KT 1 10° 10 1 10 2 

Frequency (rad/s) 


Figure 2.10 Comparison of Bode plots of discrete-time models obtained by c 2d 
and dlinmod 


discrete-time counterpart of the linearization function 1 inmod. It is appropriate to 
use the function dlinmod if a Simulink model of the continuous-time or mixed 
continuous-time and discrete-time plant is available. 

In Figure 2.10, we show the Bode plots of the discrete-time models of cart- 
pendulum system obtained by the functions c 2 d (using the default option “zoh”) and 
dlinmod. As it is seen, the plots of both models coincide which shows that these 
functions are interchangeable. 

In some cases it might be necessary for a given discrete-time model to determine 
an equivalent continuous-time model or to resample a discrete-time model to a new 
sample frequency. This can be done by using the functions d2 c and d2 d, respectively. 

2.3.4 Discretization of time delay systems 

Consider the continuous-time system with time-delay 

= Ax(t) + Bu(t - r). (2.23) 

dt 

If the time-delay x is larger than the sampling period T s , then r can be 
represented as 

r = («/ - l)T s + C, 0<C<7; 
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System 

where d is a positive integer. In such a case, the system (2.23) is discretized as [21] 
x(kT s + T s ) 1 I" A d B dl B d0 ... 01 T x (kT s ) 1 

u(kT s -(d- 1)7;) 0 0 4 ... 0 u (kT s - dT s ) 


u(kT s -T s ) 0 0 0 ... I m \\ u (kT s - 2T S ) 

u(kT s ) I I 0 0 0 ... 0 I I u (kT s - T s ) I 

(2.24) 

0 " 

0 

: u(kT s ) 

0 


A d = e ATs , 

B d0 = ( <A° do B, 

Jo 

B dl = e A(Ts - x) J e Aa doB. 

The discrete-time state-space model (2.24) has d x m extra states representing 
the past control inputs 

u(kT s - dT s ),..., u(kT s - 2T S ), u(kT s - T s ) 

which are used to describe the delay. That is why to specify the system state it is 
necessary to store the past d control vectors over a time interval equal to the time 
delay. For large r and small T s , the order of the model (2.24) may increase very much. 
Nevertheless, this model is very convenient, since it incorporates the time delay into 
the standard discrete-time state-space representation. 

If the time delay r is less than the sampling interval T s than the model (2.24) 
reduces to 


x(kT s + T s )l\A d B dl l\ x(kT s ) 

u(kT s ) J L 0 0 J L u(kT > ~ T s) 


(2.25) 


2.3.5 Choice of the sampling period 

The sampling period T s of a discrete-time system depends on several factors, including 
closed-loop performance and technology capabilities considerations. The decreasing 
of the sampling period makes the behavior of the discretized model closer to this of 
the continuous-time model but increases the requirements to the speed of the digital 
devices (A/D and D/A converters, controller, etc.). On the other hand, the increasing 
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of the sampling period creates problems related to the behavior of the system between 
the sampling instants. 

An approximate lower bound on the sampling frequency in the case of zero- 
order hold can be determined as follows. The continuous-time transfer function of 
the zero-order hold is [21] 

G zoh = 1(1 - e~ sT f. 
s 

For small sampling periods, this transfer function is approximated as 

1 - e" sT ' _ 1 - 1 + sT s - (sT s f/2 + (sT s f/6 - 1 sT s s 2 Tf 

s * ^ ~~ ~Y + ~6~ 

The first two terms correspond to the Taylor series expansion of exp~ sT d 2 . In this 
way, for small T s , the zero-order hold can be approximated by a time delay of half a 
sampling interval. Hence, the zero-order hold decreases the phase margin by 



where co c is the crossover frequency (in rad/s) of the continuous-time system. 

Assuming that the phase margin can be decreased by A <j>, it follows that the 
sampling period must satisfy 



This inequality gives a Nyquist frequency 


F n > 


(2Ajt)' 


(2.26) 


If, for instance, A <j> = 5° = 0.087 rad, then according to (2.26) it follows that the 
Nyquist frequency must be 36 times higher than the crossover frequency. Note that 
this value increases in the presence of antialiasing or notch filters, see [3, Section 6] 
for details. When considering the closed-loop performance, instead of crossover 
frequency one should take the closed-loop bandwidth (defined in Section 3.2). 

As shown by an example in [21, Chapter 3], the reachability and observability of 
a discretized linear systems may be lost for some low sampling frequencies, although 
the corresponding continuous-time system is both controllable and observable. This 
may happen when the discrete-time transfer function has common poles and zeros. 
Since poles and zeros are functions of the sampling period, a small change of T s 
can make the system reachable and/or observable again. It should be noted that the 
contemporary processors make possible implementation of very high sampling rates 
which avoids the danger of reachability and/or observability lost. 


2.3.6 Discretization of nonlinear models 

Sometimes, it is necessary to have a discrete-time equivalent of the nonlinear plant 
model (2.3) for some sampling interval T s . For example, when simulating a closed- 
loop discrete-time system it might be much faster to obtain the system transient 
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response in discrete time provided the nonlinear continuous-time plant (2.3) is 
replaced by its discrete-time equivalent 
x(k + 1) = <p(x(k), u(kj), 

y(k)=r ] (x(k),u(k)) ' 

for a fixed sampling interval T s . The discrete-time equivalent 

x{k + \) = 4>(x{k),u{k)) ( 2 . 28 ) 

of the continuous-time state equation 
jx{t)=f{t,x,u) 

can be determined by using some scheme for numerical integration of differential 
equations which ensures sufficient accuracy with small number of computational 
operations. For this purpose, it is appropriate to implement efficiently the Bogacki- 
Shampine method [28, Chapter 7] which is described as follows. 

Assuming that the discrete-time input u(k) is obtained by using a zero-order hold, 
the approximate solution x(k + 1) at the instant t(k + 1) = t(k) + h, where h = T s is 
computed by using the equations 

* =f{t(k),x{k),u{k)l 
si =f(t(k) + \,x(k) + f.s’i,w(/c)), 

S3 =f(t(k) + | h,x(k) + \hs 2 , u(k)X (2.29) 

t(k + l) = t(k) + h, 
x (k + 1) = x(k) + |(2 5l + 35 2 + 45 3 ). 

The block diagram of the nonlinear discrete-time model (2.29) is shown 
in Figure 2.11. (The discretization of the algebraic equation for the output y(k) 
is straightforward.) The model is easily implemented in Simulink. Its usage in 
simulating a nonlinear helicopter control system is demonstrated in Chapter 6. 



Figure 2.11 Block diagram of the nonlinear discrete-time model 
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2.4 Stochastic modeling 

MATLAB functions used in this section 

Function Description 

kalman Design of Kalman filters for continuous-time 
and discrete-time systems 
lyap Solution of Lyapunov equation 


2.4.1 Stochastic linear systems 

A time-invariant continuous-time linear system with stochastic inputs can be 
represented as 

x(t ) = Ax(t) + Gv(t), 

(2.30) 

y(t) = Cx(t) + w(t), 

where v(f) and w(t) are random processes. The stochastic process v(t) is called the 
process noise and the stochastic process w(t) is called the measurement noise. At each 
time, the state x(t) and the output y(t) are also stochastic processes. If v(t) and w(t) 
are Gaussian random processes, then x(t) and y(t) also are Gaussian processes. 

Assuming that the model is constructed so that v{t) and w(t) are stationary 
white noises, the mean and the covariance of the random variables v(t) and w(t) 
are denoted as 


m v 

= £{v(t)} = 0, 

(2.31) 

E{v{t + r)v(t) T } 

= QS(t), 

(2.32) 

m w 

= E {w(t}} = 0, 

(2.33) 

E [w(t + r)w(t) T ] 

= RS( r). 

(2.34) 


It is frequently assumed that the process and measurement noise are independent 
on the current and previous state and independent on each other. 

Consider the propagation of state and output means and variances of the 
continuous-time system (2.30). The initial conditions of the system are 

E{x(t 0 )}=m 0 , (2.35) 

E {x(to)x(t 0 ) T } = P(t 0 ). (2.36) 

The mean mjt) = E \x(t)} of the state and the mean m f (t) = E \y{t)} of the output 
propagate according to the deterministic dynamics of the system and are given by 

m x (t) = Ax(t), m x (t 0 ) = mo, 
m y (t) = Cm x (t). 


(2.37) 

(2.38) 
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It is possible to prove that the state covariance matrix 
Pit ) = C x (t, t) = E {[x(t) - m x (t)][x(t) - m x f} 
is the solution of matrix differential equation 

Pit) = AP(t ) + P(t)A T + GQG t (2.39) 

with initial condition P(to). 

Equation (2.39) is particularly useful to find the steady-state covariance of a 
stable time-invariant system. In such case, it reduces to the dual matrix algebraic 
Lyapunov equation 

AP + PA t + GQG t = 0. (2.40) 

If the pair (A, G) is stabilizable, then the solution of the Lyapunov equation is positive 
semidefinite (see Appendix B, Section B.4). 

The variance of the output of (2.30) is given by 
C y (t,t) = E{\y(t) - m y (t)]\y(t) - m y {t)f} = CP(t)C T + R. (2.41) 

A time-invariant discrete-time linear system with stochastic inputs is described by 
x(k + 1) = A d x(k) + G d v(k), n ... 

y(k) = C d x(k) + w(k), 1 ; 

The mean and the covariance of the random variables v(k) and w(k) are denoted as 


m v(k) = E (v(&)} = 0, (2.43) 

E{v(k)vJ\ = Q d 8(k -/), (2.44) 

m w(k) =E{w(k)}=0, (2.45) 

E {w(k)wf} = R d S(k -j ) (2.46) 

where 8(k ) is the Kronecker delta function. 

The mean m X ( k) = E {x(k)\ of the state is a solution of the linear difference 
equation 

m x{k+ 1) = A d m m , m xo = E {x 0 }. (2.47) 

The discrete-time state covariance matrix is defined as 
P{k) = E {(x(k) - m xtk) )(x(k) - m x(k) f} . (2.48) 

It is possible to prove that the state covariance at time k + 1 is the solution of 
matrix difference equation 

P(k + 1) = A d P{k)A T d + G d Q d G T d . (2.49) 

The steady-state covariance matrix of a stable discrete-time system is obtained 
as the solution of the discrete-time Lyapunov equation (or Stein equation) 

P = A d PA T d + G d Q d G T d . (2.50) 


If the pair (A d , G d ) is stabilizable, then P is a positive semidefinite matrix (see 
Appendix B, Section B.4). 
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2.4.2 Discretization of stochastic models 

In most cases instead of with a deterministic model 
the stochastic time-invariant model 

—x = Ax + Bu+ Gv, 
dt 

y = Cx + w 

where x is the state vector, y is the measurement vector and v, w are the process noise 
and measurement noise, respectively; A,B, C are constant matrices with appropriate 
dimensions. It is assumed that v and w are stationary independent zero-mean Gaussian 
white noises with covariances 

E {v(0v(T) r } = VS(t - z), E { w(t)w(r) T } = W8(t - r) 

where V, W are known covariance matrices. 

For a given sampling interval T„ it is necessary to find a discrete-time equivalent 
of the model (2.51) in the form 

x(k + 1) = A d x(k) + B d u(k) + v(k), 

y(k) = C d x(k) + w(k ) ' 

where A d , B d , C d are the matrices of the discretized model and v(k), w(k ) are discrete¬ 
time stochastic processes. The model matrices can be found in the same way as in 
the discretization of the deterministic model (2.5). For example, in the case of zero- 
order hold these matrices are found from their continuous-time counterparts by the 
expressions 

A d = e AT \ B d = [ ‘ e Aa doB, C d = C. 

Jo 

It is possible to show [8, Section 9.4.4], [44, Section 2.4.1], [45, Section 6.4.6] that 
in the case of zero-order hold the processes v(k), w(k ) represent discrete white noise 
sequences with covariances 

E {v(k)vj} = V d 8(j - k), E {Mk)wJ\ = W d 8(J - k ) (2.53) 

where 

/ T s w 

e Ar GVG T e A X dx, W d = —. (2.54) 

f 

The covariance matrix V d can be evaluated using the Taylor series approximation 

for e At , 

e At = I + At + ^{Atf + jfAtf + • • • 
which gives (up to the second order in A and third order in T s ) 

V d % T s GVG t + lf(AGVG T + GVG t A t ) 

+ lf(A 2 GVG T + 2 AGVG t A t + GVG T (A T ) 2 ). 


, the control plant is described by 

(2.51) 


(2.55) 
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If T s is very short compared to the system time constants, then one may use only the 
first term in (2.55), 

V d « T s GVG t . (2.56) 

An accurate result for V d can be found by using the Van Loan algorithm [46], Let 



is a 2-by-2 block triangular matrix, then 



and 

V d = O^d.,2 (2.57) 

This method is implemented by the M-file di srw. m which can be found on the 
Math Works® site https : / /www. mathworks . com. 

Example 2.7. Discretization of a stochastic system 

Let us compute the matrices A d and V d for the double integrator 



for T s = 1. 

Using the MATLAB function expm, one obtains that 



The approximation (2.56) produces 



It is easy to obtain a solution by (2.55) since A k = 0 for k > 2. As a result, one 
finds 
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= GVG T s + (AGVG + GVG 1 A 1 )T l J2 + 2AGVG A T//6 


This result coincides with the exact solution (2.57) and is significantly different 
from the approximate solution (2.58) obtained from (2.56). □ 


2.4.3 Optimal estimation 


: stochastic system described by the 


x(t) = Ax(t) + Buif) + Gv(t), jc( 0) = *o (2.59) 

y(t) = Cx(t ) + w(t), (2.60) 

where state x(t) e control input u(t) e output y(t) e 2 £ r \process noise v(t') e 

measurement noise w(f) e and A, B, C, G are known constant matrices with 
appropriate dimensions. The control input u(t) is a deterministic variable. It is assumed 
that v(t) and w(t) are zero mean Gaussian white noises with covariances 

E{v(t + x)v(f) T } = VS(z), (2.61) 


where V, W are known constant positive definite matrices. Equation (2.63) implies 
that v(t) and vv( t) are uncorrelated. We further assume that the pair (C,A) is detectable 
(observable) and the pair (A, G) is stabilizable (controllable). 

The estimation problem for the system (2.59), (2.60) is to determine an “optimal” 
approximation x(t) of the state x(t) using the noisy measurement vector y(t) and the 
deterministic input u{t). An optimal in stochastic sense estimate can be obtained by 
using an auxiliary linear system called optimal filter. 

Define the estimation error as 


m = Ax(t) + Bu(t) + K\y(t) - Cx{t)l „ g5) 

x(0) = x 0 ;x(t) e t%",K e !M ,rxr , 
which minimizes the quadratic cost 

J = hm E {e T (t)e(t)\ = Hm Tr[£ {e(t)e(t) T \ ], (2.66) 

is called continuous-time optimalfilter (or Kalman-Bucy filter) for the system (2.59), 
(2.60). The vector x{t) is called optimum estimate of the state x(t) of (2.59), the vector 
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and K is the optimum filter gain matrix. The gain matrix multiplies the residual 
z(t) = y(t) - Cx(t). 

Equation (2.65) may be rewritten in the form 
kt) = (A- KC)x(t) + Bu(t) + Ky(t), (2.67) 

which shows that the stability of the filter is determined by the properties of the matrix 
A — KC. Since the pair (C, A) is detectable, there exists a matrix K such that the filter 
is stable, i.e., A — KC is a stable. 

Subtracting (2.65) from (2.59) and taking into account (2.60), one obtains that 
the estimation error is a solution of the differential equation 

e(t) = (A — KC)e(t) + Gv(t) - Kw(t), e(0) = x 0 -x 0 . (2.68) 

Hence, the filter stability means stability of the estimation error. 

According to (2.40), the covariance matrix P of the estimation error e(t) for 
t —» oo is the solution of Lyapunov equation 

(A - KC)P + P(A - KCf + GVG t + KWK t = 0 (2.69) 

and the quadratic cost has the value 

J = Tr(P). (2.70) 

It is possible to show that the minimum of J is obtained if the gain matrix K and the 
initial condition x 0 are determined from [47] 

K = PC t W~ 1 (2.71) 

and 

x 0 = m X0 =E{x 0 }, (2.72) 

respectively, where the matrix P e f% nxn is the unique and positive semidefinite 
solution of the matrix algebraic Riccati equation 

AP + PA t + GVG t - PC T W~ X CP = 0. (2.73) 

Furthermore, if the pair (A, G) is controllable, then the matrix P is positive definite. 

Taking into account (2.71), (2.73) reduces to the Lyapunov equation (2.69) which 
shows that the covariance of the steady state estimation error e(t) is given by 

lhn E {e(t)e T U)\ = P. (2.74) 

The diagonal elements of the matrix P can be used to assess the covariances of the 
steady-state components of state estimate x{t). 

Since the matrix P is chosen as the positive semidefinite solution of (2.73) and 
since the pair (A, G) is stabilizable, it follows by (2.69) that the Kalman-Bucy filter 
is stable (the eigenvalues of A- K*C have negative real parts). 

Having in mind that v(t) and w(t) are zero mean, one obtains from (2.68) that 

lim m e ( t ) = 0. 


(2.75) 
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Figure 2.12 Continuous-time system with Kalman-Bucy filter 


This shows that the estimate x(t) is unbiased, i.e., 
lim E{x{t)} = lim E{x{t)}. 

The residual z(t) satisfies the relationship 

z(t) = Ce(t) + w(t) (2.76) 

and hence is a zero mean white noise whose covariance tends to 

P zU) = CPC T + W (2.11) 

The Kalman-Bucy filter is the best filter that uses a linear combination of the 
measurements. It is possible to prove that even if the noise is not Gaussian, the Kalman 
filter is still the optimal linear filter. 

A block diagram of continuous-time system with Kalman-Bucy filter is shown 
in Figure 2.12. 

The Kalman-Bucy filter (2.65) is designed in MATLAB using the function 
kalman. The function kalman designs a Kalman filter of a system with the general 
description 

x(t) = Ax(t) + Bu(t) + Gv(t), 
y(t) = Cx(t) + Hv(t) + w(t) 

where the process noise v(f) and the measurement noise w(t) can be correlated. 

Assume now that a time-invariant stochastic system is described by the difference 
state and output equations 

x(k + 1) = A d x(h) + B d u(k) + Gjv(k), 

y(k) = C d x(k) + w(k) ( ' 

where x(k) e f^, n is the state vector, y(k) e f$/ is the measurement vector, v(k) e f$ q 
is the process noise, w(k) e is the measurement noise and A d , B d , C d , G d are 
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constant matrices with appropriate dimensions. It is assumed that v(k) and w(k) are 
stationary independent zero-mean Gaussian white noises with covariances 

E {v(k)v(j) T \ = VS(j - k), E {Mk) W (j) r \ = WS(j - k) 

where V, W are known covariance positive definite matrices. 

The discrete-time optimal state estimator {Kalman filter ) of the stochastic system 
(2.78) is described by the difference equation 

x(k + 1) = A d x{k) + B d u{k) + K{y{k + 1) - C d A/x(k) - C d B d u{k)). (2.79) 
Equation (2.79) may be rewritten in the form 
x(k + 1) = (/ - KC d )A d x(k) + (/ - KC d )B d u{k ) + Ky(k + 1) (2.80) 

which shows that the stability of the filter is determined by the matrix (/ — KC d )A d . 

Provided that the matrix pair (A d , G d ) is stabilizable and the matrix pair ( C d ,A d ) 
is detectable, the optimal gain matrix K of the Kalman filter (2.79) is determined as 

K = PC d (C d PC d + W)- 1 (2.81) 

where P is the positive semidefinite solution of the discrete matrix algebraic Riccati 
equation 

A d PA T d — P + G d VG d — A d PC d {C d PC T d + W)~ l C d PA T d = 0. (2.82) 

In such case, the Kalman filter is stable (the eigenvalues of (/ - KC d )A d are inside 
the unit circle), i.e., E \x(k)\ E [x(k)} as far as k -»• oo and the mean squared 
estimation error is given by 

E {(x(k) - x(k))(x{k) - x{k)f} = P. (2.83) 

The elements of the matrix P can be used to assess the covariances of the state estimate 
x(k), similarly to the continuous-time case. 

Examples of Kalman filter application are given in Section 2.7 and in Chapter 4. 

2.5 Plant identification 


MATLAB files used in this section 


File 

Description 

ident_black_box_model 

Black box model identification 
of cart-pendulum system 

ident_gray_box_model 

Gray-box model identification of 
of cart-pendulum system 

clp_PID_controller.six 

Simulink model of the cart-pendulum 
system with manually tuned PID 
controller 

clp_P!D_validation.six 

Simulink model of the cart-pendulum 
system used for plant model validation 
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In case when a plant description is not available, one may use experimentally 
obtained input and output data to determine an appropriate plant model. This can be 
done by some identification method such as the methods described in Appendix D. 
In this section, we shall illustrate the usage of black box and gray box identification 
methods in case of unstable system. 

2.5.1 Identification of black box model 

Example 2.8. Black box identification of cart-pendulum system 

Consider the cart-pendulum system presented in Example 2.1. Assume that we do 
not know the model structure and parameters. The goal is to obtain a linear black 
box model which sufficiently well describes plant dynamics in upper pendulum posi¬ 
tion. The identified plant is inheritably unstable which requires to design a controller 
which stabilizes the system and then performing closed-loop identification experi¬ 
ment. There are many specific methods which deal with closed-loop identification, 
but some of methods described in Appendix D are also appropriate, provided that 
input signal guarantees persistent excitation of sufficient order and that the exact 
structure of the model is in the model set [48], Such methods are prediction error 
method and subspace method that uses an ARX-estimation-based algorithm to com¬ 
pute the weighting matrices [49]. They are implemented in various functions of System 
Identification Toolbox™. 

First, we design the closed-loop identification experiment. Input-output data are 
obtained by the Simulink model clp_PID_controller. six. The block scheme 
of identification experiment is presented in Figure 2.13. The plant dynamics is sim¬ 
ulated by the nonlinear model (2.1), which is implemented in Simulink subsystem 
block “nonlinear pendulum-cart model.” Furthermore, to make identification more 
realistic the 12-bit encoders are modeled by the quantizer blocks, which corrupts the 



Figure 2.13 Block scheme of closed-loop identification experiment 
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outputs with noise. Cart-pendulum system is stabilized by two outputs, one input 
discrete-time PID controller 


/ T d N (q _ l) \ 


T «W). 


where e(k) = r pos (k ) — p(k) is the cart position error, r pos (k ) = 0 is the cart position 
reference, K Ppos = -0.02, T dpos = 0.15, N pos = 2 are the parameters of PD controller 
for cart position control, K ps = 1.5, K ie = 0.4, T dfl = 0.0066, N e = 3 are the param¬ 
eters of PID controller for pendulum angle stabilization. The controller parameters 
are tuned by trial and error method. The random binary signal (RBS) is added to the 
controller output which provides persistent excitation of identification input signal. 
RBS is obtained from filtered through relay white Gaussian noise. The amplitude of 
RBS is chosen to be ±10 percent, so the control signal stays in linear region and the 
pendulum tilts enough (4—5 degrees) without falling. The input-output data sampled 
by T s = 0.01 s is obtained by the command lines 


Ts = 0.01; 
u_max = 0.5; 
unc_lin_model 


%Set uncertain parameters to their nominal values 
val_all = J; 


%Simulation 

sim('clp_PID_controller') 

datae = iddata([position.signals.values(10001:20000), ... 

theta.signals.values(10001:20000)], ... 
control.signals.values(10001:20000),0.01); 
datae.OutputName = {'Cart position','Pendulum angle'} 
datae.InputName = {'Control'} 

datav = iddata([position.signals.values(20001:21000), ... 

theta.signals.values(20001:21000)], ... 
control.signals.values(20001:21000),0.01) 
datav.OutputName = {'Cart position','Pendulum angle'} 
datav.InputName = {'Control'} 

Data is separated into two data sets—datae and datav. The first one consists 
of 10,000 samples and is used for model parameter estimation and the second consists 
of 1,000 samples and is used for model validation. Next steps are to check persistence 
excitation level of input signal and to plot data sets (Figures 2.14 and 2.15). These 
actions are done by the command lines 

pexcit(datae,10000) 
figure(1) 

idplot(datae).grid 
title('Estimation data') 
figure(2) 

idplot(datav).grid 
title('Validation data') 
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Figure 2.14 Estimation data set 
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Figure 2.15 Validation data 
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Figure 2.16 Hankel singular values of estimated models 


The excitation level of input signal is 2,500, which means that we can estimate 
up to 2,500 parameters from estimation data set. 

As mentioned in Appendix D, if we have not a priori information about model 
type and structure, the estimation procedure should be started with sufficiently simple 
black box model with few design parameters. Such model is state-space model (D.65) 
with free parametrization. It is especially useful in case of single-input-multiple- 
output plant and has only one design parameter—the model order. Assuming that the 
possible model order is between 1 and 10, we form the model set of ten state-space 
models. The order of the best model from this set is determined by MATLAB function 
n4sid with the command line 
modeln4sid = n4sid(datae,1:10) 


The resulting plot of Hankel singular values is depicted in Figure 2.16. As it is 
seen, the best model order is equal to 4. Then, the fourth order state-space model is 
estimated by 

modeln4sid = n4sid(datae,4,'N4weight','SSarx') 


The obtained model is in innovation form and has matrices 


3.84 x 10“ 3 
-0.0039 
0.04218 


0.01495 6.34 x 10“ 5 

0.9939 -1.91 x 10“ 3 

-0.05686 1.008 

-0.0151 -0.1407 


-1.94 x 10“ 5 
-0.02123 
-0.02123 
0.9942 


' -0.0682 
-1.911 
0.3206 
-5.202 
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C = 

D = 


[ -0.05427 1.536 x 1(T 3 1.38 x 1(T 5 -2.63 x 1(T 6 

[6.19 x 1(T 3 7.54 x 1(T 5 0.0204 8.03 x 1(T 4 

[0] [ -5.731 -29.69 2.268 -151.3] 

L°J ’ L - 3 - 22 x 10 “ 3 -0.1949 15.8 -76.61 J 


The values of metrics (D.67) and (D.70), defined in Appendix D, are MSE = 
2.406 x 10 -7 , FPE = 7.833 x 10 -17 . Note that using a SSARX weighting scheme 
in function n4sid allows obtaining unbiased estimates in case of closed-loop iden¬ 
tification. The next step is to perform validation tests of estimated state-space model. 
The test of residuals is done by the command lines 


figure(3) 

resid(modeln4sid,datav),grid 

title('Residuals correlation of n4sid model') 
figure(4) 

resid(datav,modeln4sid,'fr'),grid 

title('Residuals frequency response of n4sid model') 
e=resid(datav,modeln4sid); 
figure(5) 
plot(e),grid 

title('Residuals of n4sid model') 


The results from whitening test and independence test are shown in Figure 2.17. 
The frequency response of estimated high-order finite impulse response (FIR) model 


Residuals correlation of n4sid model 
AutoCorr XCorr (control) 



Figure 2.17 Residual test q/modeln4sid 
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Residual frequency response of n4sidmodel 
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Figure 2.18 Residual to input signal frequency response 


between control signal and residuals along with 99 percent confidence region is 
depicted in Figure 2.18. The residuals plot is shown in Figure 2.19. As can be seen 
from Figure 2.17, the obtained model passes both tests, which means that the model 
captures sufficiently well plant dynamics and the noise model is “good.” Figure 2.18 
shows that there is not significant dynamics between the input signal and residuals in 
the whole interested frequency range. 

It is seen from Figure 2.19 that the residual from cart position is 10,000 times 
smaller than the actual cart position and the residual from pendulum angle is 50 times 
smaller than the actual pendulum angle. 

The simulation of modeln4sid and true nonlinear pendulum-cart model in 
closed-loop operation is done by the Simulink model clp_PID_validation 
. six. The comparison between identified model outputs and true nonlinear model 
outputs is shown in Figures 2.20 and 2.21. The values of metric (D.71) for cart position 
and pendulum angle are FIT p = 70.6077 percent and FIT e = 94.0585 percent, which 
is sufficiently good result. The estimated by subspace algorithm state-space model 
describes plant dynamics very well and passes all validation tests. Then, the question 
is, “Can we describe plant dynamics sufficiently well with simpler model?”. Now we 
can try to estimate model with simpler noise description, such as ARX model (D.47). 
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Figure 2.19 Residuals of modeln4sid 
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Figure 2.20 Simulated cart position o/modeln4sid and true nonlinear model 
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Time (s) 

Figure 2.21 Simulated pendulum angle o/'modeln4sid and true nonlinear 
model 


The orders of all polynomials are chosen to be 2, so that the obtained model will be 
of fourth order. The estimation and validation is done by the command lines 

modelarx = arx(datae, 'na' , [2 2;2 2] , ' nb' , [2 ; 2 ] , 'nk' , [11] ) 
figure(6) 

resid(modelarx,datav) ,grid 
e = resid (datav, modelarx) ,- 
figure(7) 
plot(e), grid 

title('Residuals of ARX model') 

modelv = ss(modelarx) 

sim('clp_PID_pendulum_validation') 

figure(8), plot(position_validate(:,1),position_validate(:,2),'r', ... 

position_validate(:,1), position_validate(:,3),'b'), grid 
FIT_position = 100*(1 - norm(position_validate(:,3) - ... 

position_validate(:,2))/norm(position_validate(:,3) ... 

- mean(position_validate(:,3)))) 
legend( [char ('FIT_{position} = '), num2str(FIT_position)]) 
xlabel('Time [s]'), ylabel('Position [m]') 

figure(9), plot(theta_validate(:,1), theta_validate(:,2), 'r', ... 

theta_validate(:,1), theta_validate(:,3), 'b'), grid 
FIT_theta = 100 * (1 - norm(theta_validate(:,3) - theta_validate(:,2)) ... 

/norm(theta_validate(:,3) - mean(theta_validate(:,3)))) 
legend([char('FIT_{\Theta} = '), num2str(FIT_theta)]) 
xlabel('Time [»}'), ylabel('\Theta [deg]') 

The results from various tests are shown in Figures 2.22-2.25. As can be seen 
from Figure 2.22, the obtained model does not pass whitening and independence tests, 
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Figure 2.22 Residual test of modelarx 
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Figure 2.23 Residuals of modelarx 
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Time (s) 

Figure 2.24 Simulated cart position of modelarx and true nonlinear model 
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Figure 2.25 Simulated pendulum angle of modelarx and true nonlinear model 


which means that the model does not describe well plant dynamics and the noise 
model is not adequate. The maximum values of cart position residual and pendulum 
angle residual are two times greater than the residuals obtained for modeln4sid 
(see Figure 2.23). The fits (D.71) from Appendix D between nonlinear model outputs 
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and modelarx outputs are FIT P = —0.74732 percent and FIT e = 1.1636 percent. 
The negative value of cart position fit means that the obtained ARX model fits data no 
better than a straight line with slope equal to the mean of the data. The fit of pendulum 
angle is very “poor.” In general, the performance of ARX model is “bad.” 

Further improvement of identification results can be obtained by estimation of 
state-space model with MATLAB function ssest, which implements prediction 
error method. The modeln4sid is used as initial estimate of dynamics in function 
ssest. The estimated model is validated by the same tests as these applied for 
modeln4sid. The estimation and validation is done by the command lines 
init_sys = modeln4sid 
opt = ssestOptions('SearchMethod','lm'); 
modelssest = ssest(datae,init_sys, 'Ts',0.01, opt) 



title('Residuals correlation of ssest model 



plot(e).grid,title('Residuals of ssest model') 


The results from various tests are shown in Figures 2.26-2.30. Obtained model 
passes the whitening and independence tests. The residuals are similar to ones obtained 
for model 4 s id. The values of mean square error and Akaike’s final prediction error 
ar eMSE = 2.251 x 10 ,FPE = 7.208 x 10 -17 , which are closer to the correspond¬ 
ing quantities obtained for modeln4sid. The fits are FIT p = 81.028 percent and 
FITg = 92.5249 percent. Obtained fit of pendulum position is 11 percent greater than 
one of modeln4sid. 

Another useful validation test is to compare the frequency response of estimated 
models with the response of the discrete model from Example 2.6. The results are 
shown in Figure 2.31. It is seen that the magnitudes of estimated state-space model 
are close to these of the linearized pendulum model, whereas the magnitude of ARX 
model is different, which again confirms results from other tests. 

As a result we obtain two adequate state-space models. They pass all validation 
tests and describe very well pendulum dynamics. The model obtained by prediction 
error method gives better fit of the cart position. Both models can be used for controller 
design. □ 

2.5.2 Identification of gray-box model 

The gray box identification approach is illustrated by the following example. 
Example 2.9. Gray box identification of cart-pendulum system 
Consider the linearized continuous-time model of cart-pendulum system presented 
in Example 2.2. Assume that we do not know the values of cart mass M kg, pendulum 
moment of inertia / kg m 2 , dynamic cart friction coefficient f c N s/m and rotational 
friction coefficient f p N ms/rad. The goal is to estimate the unknown parameters and 
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Figure 2.26 Residual test of modelssest 
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Figure 2.27 Residual to input signal frequency response 
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Residuals of ssestmodel 
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Figure 2.28 Residuals of modelssest 
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Figure 2.29 Simulated cart position o/modelssest and true nonlinear model 



















































Magnitude (dB) 


System modeling 105 



Figure 2.30 Simulated pendulum angle of modelssest and true nonlinear 
model 


Frequency response of estimated models 
From: Control 
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Figure 2.31 Frequency responses of estimated models 
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noise model such that the gray-box model describes sufficiently well dynamics in 
upper pendulum position. We will use the estimation and validation data sets from 
Example 2.8. Note that this data is obtained by closed-loop identification experiment 
and the excitation level of input signal is 2,500. To estimate continuous time linear 
gray-box model by MATLAB, first, we must write a MATLAB function, which 
describes the model dynamics as set of first-order deferential equations. This is done 
by the command lines 

function [A,B,C,D] = pendulum_lin_modell(par,Ts) 

% 

%parameters to be identified 
M = par(1); %kg 

f_c = par(2); %N s/m 

f_p = par(3); % N m s/rad 
I = par(4); % kg m"2 

% parameters that will not be estimated 

theta_trim = 0.0; 

m = 0.104; % kg 

g = 9.81; % m/s"2 

1 = 0.174; % m 

I_t = I + m*l / '2; % kg m~2 

M_t = M + m; % kg 

den = M_t*I_t - m''2*l~2*cos (theta_trim) ; 
k_F =12.86; % N 

%% 



0 m~2*l , '2*g/den -f_c*I_t/den -f__p*l*m/den; 

0 M_t*m*g*l/den -f_c*m*l/den -f_p*M_t/den]; 


B = [0; 

0; 

I_t/den; 
l*m/den]*k_F; 

% 

C = [1 0 0 0; 

0 10 0 ]; 


D = [0; 


The next step is to write a main function, which creates gray-box model and esti¬ 
mates its parameters. The estimation is done by MATLAB function greyest which 
uses the prediction error method for estimation of state-space model in innovation 
form 


x(t) = A(6)x(t) + B(9)u(t) + Ke(t) 
y(t ) = C(9)x(t) + e(t) 


(2.85) 
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Residuals correlation of idgrey model 
AutoCorr XCorr (control) 
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Figure 2.32 Residual test of gray-box model 


where matrices A, B, and C are parameterized in the MATLAB function 
pendulum_lin_model and disturbance model matrix is free parameterized. 
Estimation is done be the command lines 

par = [0.4; 0.8; 0.000001; 0.000001] 

pendulum = idgrey('pendulum_lin_modell', par, 'c'); 

opt = greyestOptions; 

opt.DisturbanceModel = 'estimate' 

opt.Searchmethod = 'lm' 

m_idgrey = greyest(datae,pendulum,opt) 

The continuous time gray-box model is created by the MATLAB function 
i dgr ey. The initial values of unknown parameters are stored in the vector par. Here 
we set search algorithm to be the Levenberg-Marquardt method. After estimation, 
the validation tests should be performed. First, the comparison between estimated 
parameters and real ones are performed / = 0.02837, / = 0.00283, M = 0.7679, 
M = 0.768, f c = 0.50004, f c = 0.5, = 5.34 x 10“ 5 ,^ = 6.65 x 10“ 5 . It is seen 

that the values of estimated parameters are very close to their physical values. 

The results from whitening and independence tests are shown in Figure 2.32. The 
frequency response of estimated high-order FIR model between control signal and 
residuals along with 99 percent confidence region is depicted in Figure 2.33. As can 
be seen, the obtained model passes both tests, which means that the model capture 
sufficiently well the plant dynamics and the disturbance model is “good.” The cart 
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Residual frequency response of idgrey model 
From: Control 


I 



Frequency (rad/s) 


Figure 2.33 Residual to input signal frequency response 


position residual showed in Figure 2.34 is approximately 10,000 times smaller than 
the actual cart position and the pendulum angle residual is 50 times smaller than the 
actual pendulum angle, which again indicates that the model captures very well plant 
dynamics. 

The comparison between gray-box model outputs and real nonlinear model out¬ 
puts is shown in Figures 2.35 and 2.36. The values for cart position fit and pendulum 
angle fit are FIT P = 79.55 percent and FIT e = 92.27 percent, which, as expected, 
are close to the fits obtained for black box state-space model estimated by prediction 
error method. 

The comparison between frequency response of gray-box model and this of the 
linearized pendulum model is shown in Figure 2.37. It is seen that the magnitudes of 
estimated model are very close to these of linearized pendulum model in the whole 
frequency range. □ 

As a result of gray box identification, we obtain physical parameterized state- 
space model whose parameters are very close to their real values. This model passes all 
validation tests and describes very well pendulum dynamics. The disturbance model 
is very good too which gives opportunity to design both a controller and optimal 
stochastic estimators such as Kalman filter or H 0 0 filter. 
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Residuals of idgrey model 
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Figure 2.34 Residuals of gray-box model 
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Figure 2.35 Simulated cart position of gray box and real nonlinear model 
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Figure 2.36 Simulated cart position of gray box and real nonlinear model 



Figure 2.37 Frequency responses of gray box and real linearized models 
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2.6 Uncertainty modeling 

MATLAB files used in this section 
File Description 


par_pendulum_cart 

uncertain_pendulum_cart 
uncertainty_analysis 

unc_model_simulink 

unc_dscr_pendulum_cart 

unc_pendulum_cart.six 

uncertain_model_ident 


Uncertain parameters of cart-pendulum 
system 

Uncertain model of cart-pendulum system 
Analysis of the effect of uncertain 
parameters 

Deriving uncertain model from Simulink 

Uncertain discrete-time model 
of cart-pendulum system 
Simulink nonlinear model of uncertain 
cart-pendulum system 
Identification of uncertain model 


The mathematical models of control systems are rarely known exactly. In the 
general case, there exists some uncertainty in system model due to the lack of suffi¬ 
cient knowledge about its operation. The uncertainty in control plants can be divided 
into two categories: uncertain disturbance signals and dynamic perturbations. The 
former includes input and output disturbances, sensor noises, actuator noises, and 
so on. The latter represents the discrepancy between the mathematical model and 
the actual system dynamics. Typical sources of the discrepancy include unmodeled 
(usually high-frequency) dynamics, neglected nonlinearities, and system-parameter 
variations due to environmental changes and elements ageing. These modeling errors 
may adversely affect the stability and performance of the closed-loop control system 
which makes necessary to take them into account when building the plant model. 

The modeling error is referred to as structured or parametric uncertainty if it 
is associated with system parameters which vary in given ranges due to production 
tolerances or changes of operational conditions. The second type of modeling error 
is known under the name of unstructured uncertainty and corresponds to the case of 
high-frequency dynamics which is usually neglected during the model development, 
for instance time delays. 

In this section, we present several techniques to describe structured and unstruc¬ 
tured uncertainty in MATLAB and Simulink and show how to build uncertain 
state-space models of continuous-time and discrete-time plants. The corresponding 
models are used in the next chapters to analyze the robustness of uncertain closed-loop 
systems and to design controllers ensuring robust stability and robust performance of 
uncertain plant systems. 

2.6.1 Structured uncertainty models 

The structured uncertainty models are characterized by the presence of uncertain 
parameters which can be expressed in the form 

k = k{ 1 +p k S k ) (2.86) 
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Table 2.2 Cart—pendulum uncertain parameters 


Parameter 

Description 

Nominal value 

Units 

Tolerance (%) 

M 

Equivalent cart mass 

0.768 

kg 

±10.0 

I 

Pendulum moment of inertia 

2.83 x 10~ 3 

kg m 2 

±20.0 

fc 

Dynamic cart friction coefficient 

0.5 

N s/m 

±20.0 

fp 

Rotational friction coefficient 

6.65 x 10“ 5 

N ms/rad 

±20.0 


where k is the nominal value of the parameter k,pk is the relative uncertainty of k and 
8k is a real or complex uncertainty which is scaled so that 15* | < 1. The uncertain real 
parameters are represented in Robust Control Toolbox™ using the function ureal and 
the uncertain complex parameters by ucomplex [50, Chapter 1], These parameters 
may be used in arbitrary regular expressions involving the elementary arithmetic 
operations and may participate in matrix elements like the usual MATLAB variables. 
They are implemented in both continuous-time and discrete-time models. Random 
samples of these parameters are obtained by the function us ample and uniformly 
gridded samples are generated by the function gridureal. Such samples are used 
in the Monte-Carlo simulation of uncertain systems. 


Example 2.10. Uncertain model of cart-pendulum system 

Further on, we shall make use of an uncertain cart-pendulum system model, which 
is obtained under the assumption that the system parameters M, I, f c , and f p vary 
in some intervals. These variations are due to changes of the operational conditions 
or may be a result of lack of data or lack of sufficiently accurate models of some 
phenomena. Specifically, we assume that the change of the equivalent cart mass M 
is ±10 percent, the uncertainty in the value of pendulum moment of inertia is ±20 
percent and the errors in determining the coefficients f c and f p are also ±20 percent. 

In Table 2.2, we give the values determining the uncertain cart-pendulum 
parameters M, I,f c , and f p . 

The known cart-pendulum system parameters and the trim conditions are set in 
MATLAB in the usual way. The uncertain parameters are entered by the lines 

M = ureal('M',0.768Percentage',10); % kg 

I = ureal('I',2.83*10"(-3),'Percentage',20); % kg m"2 

f_c = ureal('f_c',0.5,'Percentage',20); % N s/m 

f_p = ureal('f_p',6.65*10"(-5),'Percentage',20); % N m s/rad 

and the variables depending on the uncertain parameters are computed as 

I_t = 1 + m* 1"2,■ % kg m"2 

M_t = M + m; % kg 

den = M_t*I_t - m"2*l"2*cos(theta_trim); 

The uncertain nonlinear model (2.2) of the cart-pendulum system is implemented 
by the Simulink file unc_pendulum_cart. six. The uncertain parameters 
are modeled by Uncertain State Space blocks. Using the Uncertainty 
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Value field of such block, one may specify to use the nominal value, random value or 
to sample the uncertain variable in the prescribed range. This file can be used to sim¬ 
ulate the model for various values in the uncertainty range (Monte-Carlo simulation) 
or to derive linearized uncertain plant model. 

Consider now how to build uncertain linear model of the cart-pendulum system. 
The matrices of the uncertain linear state-space model are set in MATLAB exactly in 
the same way as in the case of fixed parameters (see Section 2.2) entering the lines 

A = [0 0 1 0 

0 0 0 1 

0 m''2*l''2*g/den -f_c*I_t/den -f_p*l*m/den 
0 M_t*m*g*l/den -f_c*m*l/den -f_p*M_t/den]; 

% 

B = [ 0 


I_t/den 
l*m/den]*k_F; 

C = [1 0 0 0 

0 1 0 0 ]; 

% 

D = [0 

0] ; 

The uncertain state-space model of the cart-pendulum system is obtained using 
the function ss by the line 

G_ulin = ss(A,B,C,D) 

As a result, one obtains the uncertain state-space (uss) object 

G_ulin = 

Uncertain continuous-time state-space model with 2 outputs, 

1 inputs, 4 states. 

The model uncertainty consists of the following blocks: 

I: Uncertain real, nominal = 0.00283, variability = [-20,20]%, 

10 occurrences 

M: Uncertain real, nominal = 0.768, variability = [-10,10]%, 

10 occurrences 

f_c: Uncertain real, nominal = 0.5, variability = [-20,20]%, 

2 occurrences 

f_p: Uncertain real, nominal = 6.65e-05, variability = [-20,20]%, 

2 occurrences 

It is seen from the report that the parameters M and I occur ten times in the model 
while [ and f p occur only two times. Note that the large number of uncertain parameter 
occurrences makes difficult the analysis and especially the design of uncertain control 
systems. 

The uncertain model G„/,„ can be used to determine the time-domain and fre¬ 
quency domain plant characteristics using the corresponding MATLAB functions 
implemented in the case of fixed parameter models. 
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Figure 2.38 Bode plot of the uncertain model with output p 


In Figures 2.38 and 2.39, we display the Bode plots of the uncertain model in 
respect to the outputs p and 6, which are obtained by the lines 

omega as logspace(-2,2,50); 
figure(1) 

bode(G_ulin(1,1),omega) 
figure(2) 

bode(G_ulin(2,1),omega) 

The usual single curves of these plots are replaced by families of curves obtained 
for 20 random values of the uncertain parameters set in the prescribed ranges. 

It is instructive to consider the variations of plant “gain” as a result of the 
changes of uncertain parameters. As a measure of the relative change in the gain, 
it is appropriate to use the quantity 

d(G ulm (ja>)) 

where G u i in (s ) is the uncertain plant transfer function, G u n„(s) is the nominal plant 
transfer function, and b(G u i in (Jco )) is the maximum singular value of the frequency 
response Gfjco) for a given frequency a>. 

The relative changes of the plant gain to the individual variations in M , 7, f c , 
f p are represented in Figures 2.40-2.43, respectively. It is seen from the figures that 
the relative changes in plant gain due to the uncertainties in M and I are comparable 
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Figure 2.39 Bode plot of the uncertain model with output 6 
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Figure 2.40 Relative change in plant gain due to the uncertainty of M 
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Relative change of G„/,„ due to uncertainty in / 



Frequency (rad/s) 


1.41 Relative change in plant gain due to the uncertainty of I 


Relative change of G„;,„ due to uncertainty in f c 



Frequency (rad/s) 


Figure 2.42 Relative change in plant gain due to the uncertainty of f c 
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Figure 2.43 Relative change in plant gain due to the uncertainty off p 


in size but the changes due to the variations of M appear in wider high-frequency 
range. The changes due to the uncertainties in f c and f p have different effects. The 
changes due to f c are in the low frequency range, while the changes due to variations 
in f p have a maximum around 6 rad/s. The effect of the friction coefficient f p is 10 4 
times smaller in comparison to the effect of other uncertain parameters and may be 
neglected to simplify the plant uncertainty model. 

In Figure 2.44, we show the changes of the plant gain due to the changes in all 
four uncertain parameters. It is seen that the joint effect of the four uncertainties do 
not exceed 25 percent and is stronger in the low-frequency range. This is typical for 
the case of parametric uncertainties. □ 

2.6.2 Representing uncertain models by LFT 

Consider the connection represented in Figure 2.45. It is described by the linear system 
of equations 

:] 

w = S k z 

Performing the matrix-vector multiplication in the first equation of the system 
(2.87) and eliminating w, z, one obtains 

y = k( 1 +p k S k )u 
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Relative change of G„/ iM due to uncertainties in I, Mf c , and f p 



Figure 2.44 Relative change in plant gain due to the uncertainties of four 
parameters 



Figure 2.45 Representation of uncertain parameter by an upper LFT 


which corresponds to the uncertain parameter representation (2.86). In this way, an 
uncertain real parameter can be represented by the connection shown in Figure 2.45 
which is a particular case of the upper linear fractional transformation (LFT) shown 
in Figure 2.46. The connection, represented in this figure, consists of a fixed part 
described by the known transfer function matrix M and uncertain matrix A which 
may have a special structure. 

Let the interconnection transfer function matrix M be partitioned as 


M(s) = 


M n M u 1 
M 2 1 M 22 \ 


according to the dimensions of the vectors 
Figure 2.46 is described by 


z. Then, the LFT shown in 


y = Fu(M, A )u 


( 2 . 88 ) 
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Figure 2.46 Upper linear fractional transformation 



Figure 2.47 Representation of uncertain parameter by a lower LFT 

where 

F V (M, A) =: [M 22 + M 21 A(7 - M n A)~ l M u ] 

provided that I — Mn A is invertible. The notation Fy prompts that the upper loop of 
M is closed by A. 

The representation of the uncertain parameter 
k = k( 1 +Pkh) 

by the interconnection shown in Figure 2.45 is not unique. This parameter can also 
be represented by the interconnection shown in Figure 2.47 which is a particular case 
of the lower LFT. 

The LFTs are defined in MATLAB by the function 1ft, and the matrices M and 
A may be retrieved from a given LFT by the function If tdata. 

The LFT is universal tool for representing uncertain systems. For example, plants 
with several real uncertain parameters can be represented by the LFT, shown in 
Figure 2.46, where the matrix A is a diagonal matrix whose nontrivial elements are 
the uncertainties of the respective elements. The LFT may be also used to represent 
other type of uncertain models. 

2.6.3 Deriving uncertain state-space models from Simulink® models 

An uncertain state-space model can be derived from the nonlinear Simulink model of 
the uncertain plant using the function ulinearize. For this purpose, it is necessary 
to specify the linearization input and output points of the Simulink model using 
getlinio command. 
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In the case of cart-pendulum system, the derivation of uncertain state- 
space model is done by the M-file unc_model_simulink making use of 
the nonlinear uncertain model of the system implemented by the Simulink file 
unc_pendulum_cart. six. The derivation of uncertain model is done by the 
lines 

% Create operation point specifications for the model 
val_all = []; 

op = operspec('unc_pendulum_cart') 

% 

% Get linearization I/O settings for the model 
open_system('unc_pendulum_cart') 
io = getlinio('unc_pendulum_cart'); 

% 

%Linearization of the model 

G_unum = ulinearize('unc_pendulum_cart',op,io) 

The obtained state-space model G unum is the same as the model G uUn obtained 
from the linear state-space model, up to the ordering of state vector components. 

2.6.4 Unstructured uncertainty models 

In the case of unstructured uncertainty, the magnitude of perturbations is limited, 
but the uncertainty is not associated with specific plant parameters. The unstructured 
uncertainty can be used to represent the effect of several perturbations of different kind 
which are lumped into a single perturbation block A. The unstructured uncertainty 
can be described in different ways, depending on the specific application. The most 
frequently used descriptions are given below. 

1. Additive uncertainty (Figure 2.48). 

The uncertain plant is described as 

G(s) = G(s) + WJs)A a (s) (2.89) 

where G(s) is the nominal plant model and the weighting transfer function matrix W a 
is chosen so that d(A a (Jco)) < 1 for each co in the frequency range of interest. The 
scaling of A a is convenient in the robust stability analysis and design of the respective 
closed-loop system. 



Figure 2.48 Plant with additive uncertainty 
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Figure 2.49 Plant with input multiplicative uncertainty 



Figure 2.50 Plant with output multiplicative uncertainty 


This uncertainty represents the absolute error between the actual dynamics and 
the nominal model. 

2. Input multiplicative uncertainty (Figure 2.49). 

The perturbed plant is described by 

G(s) = G(s)(I + W m (s)A m (s)) (2.90) 

where JV m (s) is a weighting transfer function matrix chosen so that d(A(jco)) < 1. 

3. Output multiplicative uncertainty (Figure 2.50). 

In this case, the plant is described by 

G(s) = (I + W m (s)/S m (s))G(s) (2.91) 

Note that for single-input-single-output plants, models (2.90) and (2.91) 
coincide. 

The input and output multiplicative uncertainties are convenient for using since 
they are related to the relative rather than to absolute modeling error. 

The unstructured (complex) uncertainty models are built using the function 
ultidyn. The uncertain linear, time-invariant dynamics object ultidyn repre¬ 
sents an unknown stable linear system whose only known attribute is a magnitude 
bound on its frequency response. The nominal value of this uncertain object always 
has a zero transfer function matrix. Every ultidyn element is interpreted as a 
continuous-time system. However, when such element is an uncertain element of an 
uncertain state-space model (us s), then the time-domain characteristic of the element 
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Figure 2.51 Bode plot of an uncertain ultidyn element 


is determined from the time-domain characteristic of the system. Random samples 
of ultidyn element are obtained by the function usample. 

In Figure 2.51, we show the Bode plots corresponding to the four transfer 
functions of a two-input-two-output uncertain LTI object A generated by the line 

delta = ultidyn('delta',[2 2]) 

The unstructured uncertainty models (2.89)—(2.91) can be implemented for differ¬ 
ent purposes. Frequently, they are used to approximate the effect of several uncertain 
parameters in order to simplify the plant model. Example of such approximation is 
given in Chapter 4, Example 4.6. Other important application of the unstructured 
uncertainty models is to describe unmodeled dynamics, as described below. 
Consider the set of plants 

G(s) = G(s]f(s), 

where G(s) is a fixed (and known) transfer function. We desire to neglect the term 
/(.S’) (which may be a fixed transfer function or belongs to an uncertainty set) and to 
represent G(s) by multiplicative uncertainty with a nominal model G in the form 

G(s) = G(.v)(l + W m (s)A m (s)), 


where a{A. m (Jco)) < E 
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Since 


Jjtffe [G(A 


=/(-v) - U 


then the magnitude frequency response of the relative uncertainty due to the neglect 
of the dynamics of f (s), is 

| G Q)-S<>)I 

|GO»)l 

From this expression, one obtains that 


I W n (ja >)| = max I . ^ JW) I = max \f(jco) - 11. 

I G(ja>) | 

This procedure is illustrated by the following example, in which neglected time delay 
is represented by a multiplicative uncertainty. 


Example 2.11. Approximation of uncertain time delay by multiplicative 
uncertainty 

Given is the plant G = G{s)e~ xs , where 0 < r < 0.1 and G(s) does not depend on r . 
Our desire is to represent the plant by a multiplicative uncertainty and nominal model 
G(s). For this aim, first we compute the magnitude response of the relative error 

1/00 - 1| = l<? >T - 1| = V (cos(ojr) - l) 2 + sin(«r) 2 


for values of r between 0 and 0.1 and determine an upper bound max_err on this 
error. This is done by the commands 


nfreq = 100; 

omega = logspace(-1,3,nfreq); 
max_err = zeros(1,nfreq); 
for tau = 0:0.005:0.1; 
for i = 1:nfreq 

om = omega(i); 

sys_err(i) = sqrt((cos(om*tau)-1)"2 + sin(om*tau)~2); 

end 

for i = 1:nfreq 

max_err(i) = max(sys_err(i),max_err(i)); 


The frequency responses obtained are shown in Figure 2.52. Next, we find 
a second-order stable and minimum-phase approximation of the multiplicative 
uncertainty using the commands 

ord =2; % approximation order 

sys = frd(max_err,omega); % creates frd object 

Wm = fitmagfrd(sys,ord); % fits the frequency response 

As a result, for the weighting transfer function W m (s), one obtains 
1.967 s~2 + 52.9 s + 1.21 
s , '2 + 38.42 s + 535.5 
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Figure 2.52 Approximation of uncertain time delay 



Once the nominal model G is set, the uncertain plant model is found by the lines 
delta = ultidyn('delta',[1 1]); 

G_unc = G_nom*(l + Wm*delta) ^ 


2.6.5 Mixed uncertainty models 


In practice, it is customary to have the presence of both structured and unstruc¬ 
tured uncertainty in the plant model. This situation is referred to as mixed 
uncertainty. 

The appearance of structured and unstructured uncertainty in the mixed uncer¬ 
tainty model leads to a general model of an uncertain plant. All uncertain parts of 
this model are combined in a block-diagonal matrix A. This matrix has two type of 
blocks: repeated scalar blocks S\I n ,..., S s I, s which corresponds to structured uncer¬ 
tainties and full blocks A |,..., Ay corresponding to unstructured uncertainties. The 
block 


Si: 0 ... 0 
0 St 


contains scalar uncertainty <5, which is repeated r, times, i = 1 ,s. That is why, 
the scalar block dimensions are equal to n,... ,r s . The full blocks Ai,..., Ay have 
dimensions m\,...,m f , respectively. 
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The uncertain block A containing all uncertainties is defined 


where X!;=i r < + Yp= 1 m i = n an< ^ n ' s the dimension of A. The set of all matrices 
A is defined as A c C" x " . The parameters <5, of the repeated scalar blocks can be 
real numbers only, if the corresponding uncertainties are real. Note that in (2.92), all 
scalar block appear first which is done to simplify the notation. The corresponding 
functions in Robust Control Toolbox may work even with nonsquare blocks as well 
as arbitrary order of blocks. 

To build models with mixed sensitivity, it is convenient to use the functions 
sy s i c or i connec t. Examples of using the function sys i c are given in Chapter 4. 


2.6.6 Discretization of uncertain models 

Consider the linear continuous-time uncertain plant described by 



w(s) = Az(s) 


where 



' A 

Si b 2 

M = 

cT 

D u D\2 


c 2 

d 2 \ d 22 _ 


(2.93) 

(2.94) 


is the transfer function matrix of the fixed part of the system and the uncertainty A has 
the form shown in (2.92). According to (2.93) and (2.94), the uncertain continuous¬ 
time plant model can be represented as the upper LFT 

G(s) = F V (M, A). (2.95) 

Denoting by u(k), y(k), the sampled signals of u, y with sampling period T s > 0, 
the discrete-time equivalent of the uncertain plant model (2.95) is defined as 

G d (z) = Fu{M d , A„). (2.96) 

A commonly used approach to discretize (2.95), called Full ZOHapproach [51], 
is to apply sampling and zero-order holds on all signals of (2.93) as shown in Figure 
2.53, assuming that the hold and sampling devices are perfectly synchronized with the 
sampling period. This setting implies that (2.93) is discretized as stand-alone system 
disregarding (2.94) which is equivalent to discretize the fixed part transfer function 
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matrix M(s) for the specified sampling period T s . As a result of the discretization, one 
obtains a discrete-time transfer function M d (z). The discrete-time uncertain model is 
then determined as 

G d (z) = Fu(M d , A) (2.97) 

where A is interpreted now as a discrete-time uncertainty. Such interpretation is 
possible in Robust Control Toolbox since the ureal, ucomplex, and ultidyn 
objects are considered as continuous-time or discrete-time objects depending on the 
nature of the uncertain system within which they are uncertain elements. 

The Full ZOH approach leads to a simple discretization method for uncertain 
models which is sufficiently accurate for small values of T s . More accurate but more 
complicated methods are presented in [51]. 

Example 2.12. Discretization of uncertain cart-pendulum system model 

The discrete-time model DG u u„ of the uncertain cart-pendulum system model 
obtained in Example 2.6, is computed in the case of zero-order hold by the lines 
Ts = 0.01; 

[M,Delta] = lftdata(G_ulin); 

Md = c2d(M,Ts); 

DG_ulin = 1ft(Delta,Md) 

As noted previously, the functions ureal, ucomplex, and ultidyn gen¬ 
erate uncertain objects which can be implemented in continuous-time as well as in 
discrete-time models. This explains the usage of the same variable Delta in both 
continuous-time and discrete-time models. 

The Bode plots of continuous-time and discrete-time cart-pendulum system mod¬ 
els in respect to the position p and pendulum angle 9, obtained for 30 random samples 
of the uncertainty, are compared in Figures 2.54 and 2.55, respectively. It is seen from 
the figures that the Bode plot of the discretized model is close to the Bode plot of the 
continuous-time one except for frequencies near to the Nyquist frequency. The large 
errors near to this frequency are due to the properties of the method (“zoh”) used for 
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Frequency response from u top 
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Figure 2.54 Bode plots of the uncertain model with output p 


Frequency response from u to 9 
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Figure 2.55 Bode plots of the uncertain model with output 0 
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discretization of fixed model part. If instead of “zoh” method one uses “tustin”, the 
phase errors are reduced significantly. □ 

2.6 .7 Deriving uncertainty models by identification 

Uncertain plant model may be determined on the basis of the results, obtained by 
model identification. Example 2.13 illustrates the derivation of uncertainty model of 
an unstable plant using the functions of System Identification Toolbox. 


Example 2.13. Deriving uncertain model by identification 

Consider the derivation of uncertainty model of cart-pendulum system, using the 
results from black box identification of the system, presented in Example 2.8. The 
condition of unbiased parameter estimates obtained by the identification guarantees 
that the exact parameter values are contained in the confidence intervals of parameter 
estimates with probability close to 1. This allows to derive parametric uncertainty 
model with scalar uncertainties. However, since the number of estimated parameters is 
usually large, the implementation of structured uncertainty model is not practical. That 
is why, it is preferable to derive unstructured uncertainty model. Based on parameter 
3 a confidence intervals, maximum relative deviations from the nominal model in the 
frequency domain can be obtained. 

Assume that the model modeln4sid is obtained as shown in Example 2.8. 
Then, the maximum deviations of the model frequency responses from u to 9 are 
obtained and plotted by the following command lines: 

w = logspace(-1,loglO(pi/Ts) ,500) ; 

[MAG, PHASE, W,SDMAG,SDPHASE] = bode (modeln4sid, w) ; 

MAGt2 = []; MAGt2(1:length(w)) = MAG(2,1,:); 

SDMAGt21 = []; SDMAGt2(1:length(W)) = SDMAG(2,1,:); 
relmag21 = 3*SDMAGt2./MAGt2; 
figure(1) 

semilogx(w,relmag21,'r'),grid 

xlabel('Frequency (rad/s)') 

ylabel('Relative uncertainty') 

title('Relative magnitude uncertainty') 

xlim([0.1 pi/0.01]) 

% Uncertain magnitude and phase plots (3sigma confidence intervals) 
mag_nom_theta = reshape(MAG(2,1,:),size(MAG(2,1,:),3),1); 
mag_max_theta = reshape(MAG(2,1,:)-3*SDMAG(2,1,:), ... 

size(MAG(2,1,:),3),1); 

mag_min_theta = reshape(MAG(2,1,:)-3*SDMAG(2,1,:), ... 

size(MAG(2,1,:),3),1); 

% 

phase_nom_theta = reshape(PHASE(2,1,:),size(PHASE(2,1,:),3),1); 
phase_max_theta = reshape(PHASE(2,1,:)+3 *SDPHASE(2,1,:), ... 

size (PHASE (2,1,:),3) 

phase_min_theta = reshape(PHASE(2,1,:)-3 *SDPHASE(2,1,:), ... 

size(PHASE(2,1,:),3),1); 


figure(2) 
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semilogx(w,mag_min_theta,'b—',w,mag_nom_theta,'m-', ... 

w,mag_max_theta, 'r-.'), grid 
xlabel('Frequency (rad/s)') 
ylabel('Magnitude') 

title('Magnitude response from u to \theta') 

legend('Minimum magnitude','Nominal magnitude','Maximum magnitude') 
xlim([0.1 pi/0.01]) 

figure(3) 

semilogx(w,phase_min_theta,'b--',w,phase_nom_theta,'m-', ... 

w,phase_max_theta,'r-.'), grid 
xlabel('Frequency (rad/s)') 
ylabel('Phase (deg)') 

title('Phase response from u to \theta') 

legend('Minimum phase','Nominal phase','Maximum phase') 

xlim([0.1 pi/0.01]) 

The frequency plot of the relative magnitude uncertainty of the model is shown 
in Figure 2.56. Clearly, the model has larger uncertainties in the low-frequency and 
high-frequency ranges. Note that the bound of relative uncertainty is conservative 
which may lead to pessimistic results in the analysis and design. 

In Figures 2.57 and 2.58, we show the uncertainty bounds of the model frequency 
responses. These bounds can be used to derive unstructured uncertainty model used 
for robustness analysis and design. For this aim, the bounds are approximated by 
optimization procedure with shaping filter which is represented by transfer function 
of corresponding order. Example of such model is implemented in Chapter 7. □ 



Frequency (rad/s) 


Figure 2.56 Relative magnitude uncertainty 
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Frequency (rad/s) 

Figure 2.57 Uncertain magnitude response 



Frequency (rad/s) 

Figure 2.58 Uncertain phase response 


It is necessary to point out that using different estimation sets it is possible 
to obtain uncertainty models with different uncertainty bounds. This indicates that 
additional optimization may be necessary in order to obtain a model with tight uncer¬ 
tainty bounds. The alternative is to use special identification methods for uncertainty 
models, see for instance [52-54], 
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2.7 Sensor modeling 


MATLAB files used in this section 


File 

Description 

gyro_model 

Model of gyro noise 

gyro_fun 

Function used in optimization of gyro 
model 

sim_gyro_model.six 

Simulink model of gyro noise 

accel_model 

Model of accelerometer noise 

accel_fun 

Function used in optimization of accelerometer 
model 

sim_accel_model.six 

Simulink model of accelerometer noise 

filtering_design 

Kalman filter design for sensor fusion 

filtering_sim 

Kalman filtering simulation 

sim_fusion.six 

Simulink model of sensor fusion 


This section is devoted to the modeling of sensor stochastic errors which affect 
the performance of embedded closed-loop control systems. Among the large variety 
of sensors, we choose to present the modeling of microelectromechanical systems 
(MEMS) sensors intended to measure motion variables like angular rates and accel¬ 
erations. The reason behind this is that the MEMS inertial sensors (gyroscopes and 
accelerometers) have lots of applications in embedded low-cost navigation and con¬ 
trol systems. A common disadvantage of these sensors are the significant errors 
which accompany the corresponding measurements. This necessitates the develop¬ 
ment of adequate error models which may be used to achieve acceptable measurement 
accuracy with the aid of appropriate filtering. Note that triaxial gyroscopes and 
accelerometers may be combined in a single device named Inertial Measurement 
Unit (IMU) used in navigation and motion control. 

The inertial sensor errors consist of deterministic and stochastic parts. The deter¬ 
ministic part includes bias offset, scale factor error, axis nonorthogonality, axis 
misalignment and so on. These errors are removed from row measurements by the cor¬ 
responding calibration techniques, see for instance Section 3.3 [55], The stochastic 
part contains random errors (noises) which cannot be removed from the measure¬ 
ments and should be modeled as stochastic processes. The stochastic sensor errors 
comprises in-run bias variation (bias instability), rate random walk and angular ran¬ 
dom walk (for gyroscopes), and acceleration random walk and velocity random walk 
(for accelerometers). 

The gyro and accelerometer stochastic models are build using a variety of tech¬ 
niques. The most widely used tools are the power spectral density (PSD) in the 
frequency-domain and the Allan variance in the time-domain. Note that it is desirable 
to keep the model order as low as possible since the model is used in the design of 
optimal estimators based on the sensor measurements. 
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In what follows we present a simple methodology that allows to develop stochastic 
discrete-time models of MEMS gyro and accelerometer noises. The methodology is 
based on the frequency-domain and time-domain characteristics of the sensors noises 
and is illustrated for the case of Analog Devices Tri-Axis IMU ADIS16405. It is 
shown that the gyroscope and accelerometer noises may be represented by similar 
second-order models which are appropriate for usage in development of navigation 
and control systems. 


2.7.1 Allan variance 


Consider the application of the Allan variance to the time-domain analysis of random 
processes. 

The Allan variance provides a means of identifying various noise terms in the 
original data set [56,57], 

Assume that a quantity ®(t) is measured at discrete time moments t = kT s , k = 
1,2,... ,L with a sample time T s . The average value of © between times t(k) and 
t(k) -(- x where x = mT s , is given by 

ft WW= e(t+ ”>- 9<t) 


where ®(k) = ®(kT s ). 

The Allan variance is defined as 

o\x)=\[{h(k + m)-Sl{k)) 2 ) 

= ((©(* + 2m ) ~ 20 (* + m) + 0 (£)) 2 } 

where { > is the ensemble average. 

The Allan variance is estimated as follows 


(2.98) 


L—2m 

° 2 (r) = 2z 2 {L _ 2m) E W + 2m> > ~ 20 ^ + w ) + ®W) 2 - (2-99) 

The computation of Allan variance of a given random process corresponds to the 
filtration of this process by using a filter whose bandwidth depends on the value of r. 
This makes possible to examine different types of random processes by varying r. 
The Allan variance is usually plotted as a function of x on a log-log plot. 

Consider the application of Allan variance to some simple random processes used 
to describe the stochastic errors in different devices. 

The Allan variance of the white noise is given by 



The Allan variance of the random walk is given by 





System modeling 133 


The Allan variance of the first-order Gauss-Markov process is determined as [57] 

-4e~r +e“ 2r/:r )J (2.100) 

This expression leads to the following conclusions. If r is much longer than the 
correlation time T, it is found that 

o 2 (t) =► x » T 

which is the Allan variance for white noise with strength a 2 . For r much smaller than 
the correlation time, (2.100) reduces to 



a (z) =4- , r «: T 


which is the Allan variance for random walk with driving noise of strength o 2 /T 2 . 


2.7.2 Stochastic gyro model 

The MEMS gyroscope noise typically consists of the following terms: 

• The bias is a time-variant error, which is independent of the angular rate and may 
be represented as a sum of static and dynamic components. The static component, 
also known as the fixed bias, tum-on bias or bias repeatability, comprises the run- 
to-run variation of each gyroscope bias plus the residual fixed bias remaining after 
sensor calibration. It is constant throughout an IMU operating period, but varies 
from run to run. The dynamic component, also known as the in-run bias variation 
or bias instability, varies over periods of order a minute and also incorporates the 
residual temperature-dependent bias remaining after sensor calibration. The bias 
instability is a low-frequency process whose origin are components susceptible 
to random flickering. The intensity of bias instability is inversely proportional to 
the frequency (1// noise) and is characterized by nonstationary autocorrelation 
function. The bias instability is typically expressed in deg/h, where 1 deg/h = 
4.848137 x 10“ 6 rad/s. 

• Rate random walk (RRW). This is a rate error due to white noise in angular acceler¬ 
ation. The RRW is a nonstationary process whose intensity increases linearly with 
time. This error is typically expressed in deg/h/\/h or in deg/h 2 /\/Hz, where 
1 deg/h/Vh = 8.080228 x 10“ 8 rad/s/y^ and 1 deg/h 2 /y^fe = 1.346705 x 
10 -9 rad/s/y's. 

• Angular random walk (ARW). This is an angular error which is due to the white 
noise in angular rate. The ARW is described by the first-order differential equation 


where w is white input driving noise. The strength of this noise is typi¬ 
cally expressed in deg/Vh or in deg/h/VHz where 1 deg/Vh = 2.90888 x 
10“ 4 rad/Vi and 1 deg/h /Vm = 4.848137 x 10“ 6 rad/Vs. 
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Figure 2.59 Output gyro noise 


• Quantization error. This is an error representing the rate quantization noise due 

to the analog-to-digital conversion. This error is expressed in deg/s. 

Other gyro noise terms are described in detail in [57], 

The derivation of stochastic discrete-time model of gyro noise is illustrated by 
Example 2.14. 

Example 2.14. Derivation of stochastic gyro noise model 

The model is obtained using the M-file gyro_model. For this aim, we use L = 10 6 
samples of one of the gyro outputs of ADIS16405 IMU [58] measured at rest with 
frequency f = 100 Hz during the period of 10,000 s. After removing a small constant 
bias of-0.2071 (deg/s) we found that the noise standard deviation is (to six digits) 

a x = 0.382981 (deg/s). 

The first 1,000 samples of the centered output gyro noise are shown in Figure 2.59. 

To determine the individual terms of the gyro noise, we study its frequency 
domain and time domain characteristics. In the frequency domain, we make use 
of the one-sided PSD of gyro noise, determined by the function pwelch from 
MATLAB and shown in Figure 2.60. The PSD is computed for frequencies up to 
50 Hz. To find the different error components, the PSD is approximated by straight 
lines of different slopes. (The coefficient 2 comes from the fact that the one-sided PSD 
is twice the two-sided PSD used in the approximation.) Based on the PSD approxi¬ 
mation, we conclude that there are three noise components, namely bias instability, 
angular random walk and rate random walk characterized by the parameters B, N 
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Power spectral density of gyro noise 
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Figure 2.60 Spectral density of gyro noise 


and K, respectively. Since the gyro has 14-bit resolution, its quantization error is 
negligible. 

In the low-frequency range, the PSD is approximated by the term 

2K 2 

m 2 

for some constant coefficients, which indicates the presence of random walk process. 
This term can be presented as output of an integrator with white noise driving input 
of strengths 2 . 

In the frequency range between 10 -3 and 10 -2 Hz, the PSD is approximated by 
the term 

2 B 2 

which cannot be presented as an output of a shaping filter with rational transfer 
function and white noise driving input. Further on, an appropriate approximation 
of bias instability is done by first-order Markov process generated as the output of 
first-order lag with white noise input. 

The third section of the PSD is approximated by a horizontal line which shows 
the presence of a white noise in the measured rate, corresponding to the angle random 
walk. This noise is of strength N 2 . 

To determine the parameters B, N, and K precisely, we use the Allan variance of 
gyro noise, computed with overlapping estimates, and shown in Figure 2.61. 
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Figure 2.61 Allan variance of gyro noise 

The Allan variance of the white noise corresponding to the angular random walk 
has a slope of -1/2 on the log-log plot of <x(r) versus r. The numerical value of N 
can be obtained by reading the slope line at r = 1. 

The Allan variance of the bias instability is represented by a horizontal line 
drawn at 

o-(t) = 

on the log-log plot of rr(r) versus r [57], This allows to find simply the value of B. 

The Allan variance of random walk is represented by a slope of +1/2 on the 
log-log plot of er(r) versus r. The value of K can be read off the slope line at t = 3. 
As a result, one obtains the values 

• B = 1.20 x 10“ 2 deg/s = 43.2 deg/h, 

• K = 5.00 x 10 -4 deg/s/Vs = 0.2324 deg/h/Vh, 

• N = 3.88 x 10“ 2 deg/Vs = 2.328 deg/Vh 

which are used in the PSD approximation of gyro noise, shown in Figure 2.60. 

The stochastic modeling of gyro noise consists in determining appropriate shap¬ 
ing filters with random noise driving inputs whose outputs approximate the respective 
gyro noise components with sufficient accuracy. For this aim, we shall use a simple 
optimization algorithm which minimizes the difference between the gyro noise PSD 
and PSD of the approximate model. In accordance with the analysis presented, the 
approximate noise model is taken in the form 

x = x bias +x rrw +x arw , 



( 2 . 101 ) 
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where x bias , x m ’, and x anv stand for bias instability, rate random walk, and angular 
random walk driving noise, respectively. 

An approximation of the bias instability is obtained by the output of a discrete¬ 
time first-order filter 

x(k + l) Was = a d x(k) bias + b d v(k), (2.102) 

where a d , b d are filter coefficients and v is an input white noise. This filter is obtained 
by discretization of the first-order Gauss-Markov process 

Tx(t)+x(t) = v(t), 

where T is the correlation time. The correlation time is determined by an opti¬ 
mization procedure along with the input noise strengths. The coefficients a d , b d are 
determined as 



where AT = T s is the sampling period. 

The random process x rrw is taken as 

x rn "(z) = DF(z)w(z) (2.103) 


is the transfer function of discrete-time integrator and w is an input white noise. 

Finally, the driving input of angular random walk is modeled by the discrete-time 
white noise x arw . 

The discrete-time white noises v, w, and x arw are obtained as 
v = K gl r u w = K g2 r 2 , x arw = K g3 r 3 

where K gl , K g2 , K g3 are unknown coefficients and r t , r 2 , r 3 are zero mean pseu¬ 
dorandom sequences with standard deviation equal to 1 and length 10 6 generated by 
the function randn. Note that the parameters K gl , K g2 , K g} represent the strengths 
of the corresponding input driving noises. 

In this way, the gyro noise model is characterized by the four unknown parameters 
T, K g] , K gl , and K g3 . They are determined by an iterative procedure, minimizing the 
difference P x — P x where P x is the PSD ofic, as defined in (2.101), and P x is the PSD 
of the gyro noise x obtained experimentally. The optimal values of these parameters 
are found by the function 1 sqnonl in from MATLAB which implements a nonlinear 
least squares minimization method. The initial values of the unknown parameters are 
taken as 

T = 30, ^ = 1, K g2 = 1, K g3 =o x . 

The one-sided PSD of the approximated gyro noise is determined by the function 
pwelch with overlapping sections of the same length. Best results are obtained when 
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the length of these sections is taken equal to 50,000. As a result, after 110 iterations 
one obtains the following parameter values (rounded to six significant digits) 

T = 27.9780 s, 

K gl = 0.890636 (deg/s)Vs, K gl = 0.00687997 (deg/s)/Vs, 

Kg 3 = 0.376935 deg/Vs. 

Since the length of the approximation noise is taken sufficiently large (10 6 sam¬ 
ples), the optimal parameters obtained are statistically reliable which is verified by 
the noise model simulation. Note, however, that the correlation time T may be very 
sensitive to the changes of initial conditions. 

The discrete-time gyro noise model thus obtained may be represented in the form 


x(k) = x(kf as + x(k) rrw + x(k) arw , (2.104) 

where 

x(k + 1 f as = a d x(k) bias + b d K gl v(k) bias , (2.105) 

x(k + 1 Y rw = x(k) rnv + ATK g2 r](ky rw , (2.106) 

x(k) arw = K g3 r](k) arw (2.107) 


where r\ blas , rf™, r] arw are white noises of unit strength. 

Equations (2.104)-(2.107) are represented in the standard form 
x(k + 1) = Ax(k) + Gv(k), 
y(k) = Cx(k) + Hv(k) 


(2.108) 


where x(k) = [x(k) bias , x(k) rm ] T , y(k) = x, v(k) = [r](k) bias , r)(ky™, ri(k) arw ] T , 
and 


r?!i 


, 0 0 ] 

ATKg, 0 


// = [0 0 K g3 ], C= [ 1 1]. 

The model is of second order and, its output v is expressed in degrees per second. If 
it is necessary to express the model output in radians per second, then the coefficients 
K gl , K gl , and K g3 should be multiplied by pi/ 180. 

As it is seen from Figure 2.62, the PSD of the model noise, generated according 
to (2.101), fits well the PSD of the measured noise. 

The Simulink model of the gyro noise, build upon (2.104)-(2.107), is shown in 
Figure 2.63. □ 


2.7.3 Stochastic accelerometer model 

Similarly to gyro noise, the MEMS accelerometer noise may be represented as a sum 
of the following terms. 
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Power spectral density 



Figure 2.62 Spectral density of gyro noise and model 
Simulink gyro noise model 



Number3 


Figure 2.63 Simulink ® gyro model 


Bias instability. The accelerometer bias instability is typically expressed in mg 
(10 -3 x g), where g = 9.80665 m/s 2 is the earth gravitation unit. 

Acceleration random walk (ARW). This is an acceleration error due to white noise 
in jerk. The ARW is typically expressed in mg/Vh where lmg/Vh= 1.634442 x 

10 -4 m/s 2 /Vs. 
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• Velocity random walk (VRW). This is a velocity error due to white noise in 
acceleration measurements. The VRW is described by the first-order differential 
equation 


where V is the velocity and w is white acceleration noise. The strength of this 
noise is typically expressed in m/s/>/h, where 1 m/s/Vh = 0.0166667 m/s/^/s. 
• Quantization error. This error is expressed in g. 

To develop a model of the accelerometer noise one can implement the same 
methodology as in the case of gyroscopes. This is due to the fact that the PSD and Allan 
variance of the MEMS accelerometer noise have properties similar to the respective 
gyro characteristics. 

Example 2.15. Accelerometer noise model 

The derivation of noise model is done by the M-file accel_model. 

In the given case we use 10 6 samples of one of the accelerometer outputs of 
th e ADIS16405 Inertial Measurement Sensor measured at rest with frequency f = 
100 Hz (Figure 2.64). The standard deviation of the zero mean noise is found to be 
<T Xa = 3.247324 x 10“ 3 g. 

The accelerometer noise is modeled as 

x a = + x a ™ + x v ™, (2.109) 

where x h a ,a \ x a a rw , and x v a rw are the accelerometer bias instability, acceleration random 
walk, and velocity random walk driving noise, respectively. The unknown model 



Figure 2.64 Output accelerometer noise 
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Frequency (Hz) 

Figure 2.65 Spectral density of accelerometer noise and model 


parameters are the time constant T a of the bias instability, the strength K ai of bias 
instability driving noise, the strength K ai of the acceleration random walk, and the 
strength K a3 of the velocity random walk. As a result of the optimization procedure, 
after 120 iterations, one obtains 

T a = 4819.36 s, 

K ai = 2.69875 gVI, K ai = 0.00206606 g/y/i, K a} = 0.00303117 gs/Vs. 

The output of accelerometer model (2.109) is measured in g. To obtain the output 
in m/s 2 it is necessary to multiply the coefficients K a] , K ai , and K m by 9.80665. 

The accelerometer noise PSD and the model noise PSD are shown in Figure 2.65. 
Better results can be obtained by using higher order shaping filters but this may 
complicate the noise model. □ 

We note at the end of this section that in some cases, it might be justified to 
use simplified models of gyroscope and accelerometer noises in order to reduce the 
overall system order and thus to reduce the embedded controller order. For instance, 
in low cost navigation systems, the gyroscope noise is frequently modeled using only 
the rate random walk and angular random walk terms and the accelerometer noise 
is modeled taking only the velocity random walk term. Corresponding noise models 
can be obtained by the procedure described using only the desired terms. 
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2.7.4 Sensor data filtering 

MATLAB files used in this section 


File 

Description 

filtering_design 

Design of Kalman filter for single-axis 


attitude estimation 

filtering_sim 

Simulation of the single-axis attitude 


estimation system 

sim_fusion.six 

Simulink simulation model 


The data obtained by different sensors may be fused applying Kalman filtering to 
obtain better accuracy in comparison to the usage of separate sensors. This is achieved 
thanks to the properties of the Kalman filter and the fact that different sensors have 
independent stochastic errors. 

Example 2.16. Single-axis attitude estimation 

Consider the problem of single-axis attitude estimation using attitude angle measure¬ 
ments and gyro rate information. The block diagram of the sensor fusion model is 
shown in Figure 2.66. The gyro output 

cb = m + A co 

consists of the reference signal co and the additive gyro noise Aco. The attitude 
measurements are obtained by a sensor whose output 

6 = 0(k) + A 0 

is corrupted by the error AO. The gyro and angle measurements are used as inputs 
of a Kalman filter which produces the optimal attitude estimate 0. The quantity 
A 0 = 6—0 represents the attitude estimation error. 



Figure 2.66 Block diagram of the sensor fusion model 
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Assume that the gyro noise satisfies the model given by (2.108). Hence, the angle 
rate to = 0 is related to the gyro output w by the equation 

9 = 5>- x bias -x rrw - x arw (2.110) 

where x bms is bias instability, x rnv is rate random walk, and x arw is angular random 
walk driving noise. Note that x(k) bias , x(ky w , and x(k) arw are measured in degrees. 
Equation (2.110) is discretized in the form 

0(k + 1) = 0(k) + AT(£)(k) - x(kf as - x(k) rrw - x(k) arw ) (2.111) 

where the bias and rate random walk are solutions of the difference equations 

x(k + \f as = a d x(k) bias + b d K gl rj(k) bias , (2.112) 

x(k +l) rrw = x(k)'™ + ATK g2 v(k) rm , (2.113) 

respectively. 

The attitude measurements are written in the form 
e = 6(k)+v enc (2.114) 

where the encoder error if nc represents a white quantization noise. Assuming that an 
8-bit encoder is used, the intensity of the quantization noise is equal to 

o 2 enc = q 1 / 12, q = 360/2 8 , 

where the coefficient 360 corresponds to noise measured in degrees. 

Equations (2.111)-(2.114) are written in the standard form 

x(k + 1) = Ax(k) + Bu(k) + Gv(k), 

y(k) = Cx{k) + w(k) y ’ 

where 

x(k) = [9(k), x(k) bias , x(ky™Y, 
u(k) = oo(k), 
y(k) = m, 

v(k) = [r,(k) bia \ r,(k)™, q(ky™] T ,w(k)=r ] (kT c 
and 

‘1 —AT -ATI [AT' 

A = 0 a d 0 , B — 0 , 

_0 0 1 J |_ 0 

0 0 -A7X g3 ' 

G = b d K gl 0 0 , C=[l 0 0]. 

0 ATK g2 1 

The noises v and w have covariances given by 
E {v(k)vj} = V8(J - k ), E \w(k)wj\ = WS(j - k), 
where V = h and W = oj nc . 
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Time (s) 

Figure 2.67 Estimate error and bounds 


Equation (2.115) is used to design a third-order Kalman filter 
x(k + 1) = Ax(k) + Bu(k) + K(y(k + 1) - CAx(k) - CBu(k )) (2.116) 

which determines the optimal estimate x(k) of x(k) based on the noisy measurements 
u(k) = o) and y(k) = 9. The steady-state value 

P = E {(x(k) - x(k))(x(k) - x{k )) r ]. 

of the variance of x(k) — x(k) is given by the positive definite solution P of the 
associated Riccati equation 

APA t -P+V- APC t (CPC t + W)~ l CPA T = 0. 

Therefore, the predicted standard deviation cr err of the estimate error A 9 = 9 (k) — 
9(k) can be determined as the square root of the element P(1,1). This gives o en . = 
0.0404785. Note that the encoder error is characterized by standard deviation o enc = 
0.405949 which is more than ten times larger than o err . 

The system (2.115) along with the Kalman filter (2.116) are modeled in 
Simulink using the file sim_fusion. six. Synthetic measurements are created 
using a true angular rate 0 = 0.015 deg/s. The standard deviation of the actual esti¬ 
mation error is found as o err = 0.0402275 which is slightly smaller than the predicted 
value. 

A plot of the attitude-angle error 9 — 9 and the 3<r bound equal to ±0.121435 
are shown in Figure 2.67. It is seen that the Kalman filter provides filtered estimates 
whose errors are indeed bounded by the theoretical 3a bounds. □ 
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2.8 Notes and references 

The process of mathematical modeling is essential in science and engineering. The 
development of control system models is a large area of scientific research and there 
exists a vast literature on this subject, see for instance Bishop [2]; de Silva [59]; 
Egeland and Gravdahl [60]; Fishwick [61]; Golnaraghi and Kuo [62]; Isermann [20]; 
Kamopp, Margolis, and Rosenberg [63]; Kulakowski, Gardner, and Shearer [64]; 
Ljung and Glad [65]; Spong, Hutchinson, and Vidyasagar [66], The plant mod¬ 
els should be developed so that to take into account the structure and parameter 
uncertainties keeping at the same time model order low to simplify the controller 
design. 

The detailed derivation of equations describing the motion of cart-pendulum 
system can be found in many sources, see for instance Boubaker and Iriarte [67] and 
Ogata [68, Chapter 3], 

The linearization of nonlinear models is considered in almost every textbook 
on control theory, see Goodwin, Graebe, and Salgado [43, Chapter 3]; Ogata [68, 
Chapter 3]; Franklin, Powell, and Emami-Naeini [69, Chapter 2]; Golnaraghi and 
Kuo [62, Chapter 4] where this technique is described in details. 

The discretization of continuous-time systems and properties of various dis¬ 
cretization methods are considered in depth in the corresponding chapters of Franklin, 
Powell, and Workman [8]; Goodwin, Graebe, and Salgado [43]; Hendricks, Jan- 
nerup, and Sorensen [45], Various considerations about the choice of sampling 
frequency may be found in [21, Chapter 8], [8, Chapter 11], [43, Chapter 12], [45, 
Appendix D], [4, Chapter 2], [26, Chapter 15], 

The theory of stochastic control is presented in several books, among them 
Astrom [70]; Bryson and Ho [71]; Maybeck [72]; Hendricks, Jannerup, and Sorensen 
[45, Chapter 6]; Speyer and Chung [73]. The discrete-time Kalman filter is pro¬ 
posed by R.E. Kalman [74] and is one of the most versatile tools of modem control 
engineering. The theory of Kalman filter is presented in lots of books, among 
them Anderson and Moore [75]; Astrom [70]; Bryson and Ho [71]; Crassidis and 
Junkins [76]; Gibbs [77]; Fewis, Xie, and Popa [44]; Simon [78] and Speyer 
and Chung [73], The book of Grewal and Andrews [79] deserves special attention 
since it considers in detail the application of Kalman filtering using MATFAB. 
A very readable introduction to the theory of Kalman filter is given by Athans 
[80, Chapter 13], 

As noted in Bittanti and Garatti [81], control science is basically a model based 
discipline and the performance of control is determined by the accuracy of the model 
representing data. Building uncertain system models is an important step in the design 
of robust control systems. Unfortunately, the derivation of uncertain plant models may 
be much more difficult in comparison with modeling of plants with fixed structure 
and parameters. 

A detailed discussion of the properties of EFT and their using to model uncertain 
systems can be found in [82, Chapter 10], 

Different components of the gyro and accelerometer systematic and random 
errors are described in detail in Aggarwal et al. [55], Groves [83], Titterton and 
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Weston [84], IEEE Standard 952-1997 [57], Techniques for building models of 
MEMS sensor noises are presented in Maybeck [72], Farrell [85], Siouris [86], Instead 
of using the PSD, sometimes it is preferred to exploit the autocorrelation function of 
the noise in order to obtain first-order Gauss-Markov or higher order auto-regressive 
models. However, as noted in [57], the correlation methods are very model sensitive 
and not well suited for higher order processes. 



Chapter 3 

Performance requirements 
and design limitations 


The controller design aims to provide a control signal (control action) which will 
force the plant to behave in a desired fashion, i.e., to change the output according 
to a set of performance requirements. In classical control, the performance specifi¬ 
cations are given in terms of desired time-domain and frequency-domain measures, 
such as step response specifications (overshoot, rise time, settling time), frequency 
response specifications (bandwidth, crossover frequency, resonance frequency, reso¬ 
nance damping) and relative stability in terms of gain margin (GM) and phase margin 
(PM). Further on, significant specifications are given in terms of disturbance attenu¬ 
ation and noise suppression. A very important requirement is to achieve the necessary 
performance in the presence of different plant uncertainties, i.e., to ensure robustness 
of the closed-loop system. 

In this chapter, we consider briefly some important issues concerning the per¬ 
formance requirements to closed-loop linear systems and the fundamental design 
limitations in achieving the control aims. The performance specifications are formu¬ 
lated in continuous-time due to the clear physical interpretation in this case. First, we 
present the relatively simple case of single-input-single-output (SISO) systems which 
are well studied in the classical control theory. The trade-offs in the design of such 
systems are shown in some details. Then, we discuss the more complicated case of 
multiple-input-multiple-output (MIMO) systems whose performance is investigated 
by using the singular value plots of certain closed-loop transfer function matrices. An 
important issue in controller design is the closed-loop system performance in pres¬ 
ence of different uncertainties. At the end of the chapter, we present some elements 
of the contemporary approach to the robustness analysis of uncertain linear systems 
based on the small gain theorem and structured singular value (SSV). 


3.1 SISO closed-loop systems 

MATLAB® function used in this section 

Function Description 

loopsens Sensitivity functions of closed-loop system 
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The typical block diagram of a negative feedback SISO system is shown in 
Figure 3.1. It consists of a control plant with transfer function G and one degree-of- 
freedom controller with transfer function K. The controller has only one input which 
determines its name. The closed-loop system is a subject to reference r, disturbance d, 
and measurement noise n. The input to the controller's) is r — y m , where y m =y + n 
is the measured output. 

In the more general case, the disturbance is applied to a separate plant input 
which reflects its action at some internal point of the plant. Since the plant is linear, 
its output may be represented in the form 

y = G u (s)u + G d {s)d, 

where G u and G d are the corresponding transfer functions in respect to control and 
disturbance. 

In this way, the system is reduced to the form, shown in Figure 3.2, which means 
that this system can be represented again by block diagram in Figure 3.1, modifying 
the disturbance in appropriate way. 

The control action (plant input) is obtained by the following equation: 


u = K{s)(r-y-n). (3.1) 

The control aim is to obtain a signal u (i.e., to design a controller K), such that the 
system error 

remains small in the presence of disturbance d and noise n. 

The exogenous actions to the system have different character. The reference r and 
the disturbance d have usually deterministic character and their spectrum is in the 
low-frequency range. The measurement noise n is a random process and its spectrum 
as a rule is in the high-frequency range. The determination of these actions is done on 
the base of plant functioning analysis and may require some laboratory experiments. 
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f 


Figure 3.2 Disturbance conversion to plant output 


The reasons for using feedback control are 

1. Uncertainty in signals—uncertain disturbance and inaccurate statistical charac¬ 
teristics of noise. 

2. Uncertainty in the plant model. 

3. Plant instability. 

The third reason follows from the fact that an unstable plant can be stabilized 
only by feedback. 

In the general case, the usage of feedback reduces the model uncertainty that 
involves signal uncertainty and plant model uncertainty. 

For the system shown in Figure 3.1, the plant model is described by the following 
equation: 


y = Gu + d. 


(3.2) 


The substitution of (3.1) in (3.2) yields 
y = GK(r-y-n) + d 


or 


(/ + GK)y = GKr + d — GKn. 


Hence, the closed-loop response is 


_ GK 
y ~ I + GK V + 



n. 


(3.3) 



s 


T 


The system error is given by 

e = y — r = —Sr + Sd — Tn, 


(3.4) 
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where one utilizes the fact that T — 1 = —S. The corresponding plant input is 


u = KS(r -d-n ). 


(3.5) 


Further on, we use the following notation: 

L = GK — transfer function of the open-loop system, 

S = -= - — sensitivity function, 

I + GK I + L 

GK L , . . . ^ 

T — -= - — complementary sensitivity function. 

/ + GK I + L 

Equation (3.3) may be rewritten as 

y = Tr + Sd — Tn. (3.6) 

Clearly, S is the closed-loop transfer function from the disturbance to the output, 
while T is the closed-loop transfer function from reference to the output. The transfer 
function —T may be considered as the noise transfer function. The term complemen¬ 
tary sensitivity for T comes from the identity 

S + T= 1. (3.7) 

The open-loop transfer function L and the sensitivity functions S and T are 
determined from transfer functions G and K in MATLAB by using the function 
loopsens. 

Better closed-loop performance may be achieved by using the so-called two 
degree-of-freedom controllers. Typical two degree-of-freedom controller is shown in 
Figure 3.3. It has separate inputs for the reference r and measured output y m and one 
output u. The linear two degree-of-freedom controller may be separated in two blocks, 

K = \K r K y ], 
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where K y is the feedback part and K r is a reference prefilter. As a result, one has that 
u = K r r + K y y m . (3.8) 

The closed-loop system structure in this case is shown in Figure 3.4. The feedback 
is used to reduce the uncertainty effect (disturbances and model errors), while the 
prefilter ensures the necessary tracking accuracy. 

The closed-loop transfer functions can be modified easily in the case of two 
degree-of-ffeedom controller taking into account the relationship (3.8). 


3.2 Performance specifications of SISO systems 


MATLAB functions used in this section 


Function 

Description 

loopmargin 

Stability margins of closed-loop system 

bode 

Bode frequency response 

nyquist 

Nyquist frequency response 


3.2.1 Time-domain specifications 

The standard specifications of time-domain performance of SISO system in case 
of step reference are illustrated in Figure 3.5. The most important time-domain 
characteristics are as follows: 

• Overshoot: The first peak value of step response, divided by the steady-state 
value y ss . In case of unit step response, the overshoot is given by the value of M 
and is expressed in percent. Typically, it shouldn’t exceed 30 percent. 

• Rise time (t r ): The time required for the output signal to reach 90 percent of its 
steady-state value. Should be as small as possible. 
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Figure 3.5 Specification of time-domain performance 


• Settling time (t s ): The minimum period of time after which the unit step response 
remains within 5 percent of its steady-state value. Should be as small as possible. 

• Steady-state error (offset): The difference between the steady-state value of output 
response and its reference value. Should be as small as possible. 

3.2.2 Frequency-domain specifications 

Important performance specifications in the frequency domain are the GM and PM, 
maximum peaks of sensitivity functions, crossover, and bandwidth frequencies. 

Let L(s) he the transfer function of the open-loop system with negative feedback. 
The typical Bode plot of the open-loop system, illustrating the notion of GM and 
PM, is shown in Figure 3.6. 

The GM is defined as 

GM = i r / • 1 (3-9) 

where phase crossover frequency «i8o is the frequency for which the phase frequency 
response of L(jco) crosses the axis —180°, i.e., 

ZZ(M so) = -180°. (3.10) 

The GM is the factor, by which the open-loop gain \L(Ja>)\ may be increased before 
the closed-loop system becomes unstable. Usually, it is required that GM > 2 = 6 dB. 
The PM is defined as 


PM = ZL(jco c ) + 180°, 


(3.11) 
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Figure 3.6 Bode plot of open-loop system with PM and GM indicated 


where the gain crossover frequency co c is the frequency, for which \L(jco)\ crosses 
for the first time 1 from above, i.e., 

\L(M)\ = 1. 

The PM shows what amount of negative phase (phase lag) can be added to L(s) at 
frequency co c before the phase at this frequency to become -180°, which corresponds 
to closed-loop instability. Usually, it is required that PM be greater than 30°. 

An alternative to classical GM and PM is the disk margin. The disk margin is the 
largest region of the complex plane such that for all gain and phase variations inside 
the region the nominal closed-loop system is stable. The definition of the disk margin 
is illustrated in Figure 3.7 which shows the Nyquist plot of a third-order open-loop 
system with transfer function 

0.22s 1 +11 

W 0.28s 3 + 1.437s 2 + 6.6s + 18' 

The cross-points denoted by GM and PM indicate the classical GM and PM for the 
system, while the points denoted by disk gain margin (DGM) and disk phase margin 
(DPM) indicate the disk gain and disk PMs, respectively. The disk margins provide a 
lower bound on classical GM and PM [50], Both classical and disk stability margins 
may be determined using the Robust Control Toolbox™ function loopmargin. 

In case of uncertain system model, it is more appropriate to use the worst case 
GM and PM (see Section 3.8). 
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Figure 3.7 Disk gain and phase margins 


The GM and PM are related to the maximum peaks of the sensitivity and 
complementary sensitivity functions defined as 

M s = max |5'(y&;)|, M T = max \T( joo)\. 


It is possible to show [87] that for M T = 2 (6 dB), it is guaranteed that GM >1.5 and 
PM > 29° and similar relationships exist involving M s . Larger values of M s and M T 
indicate poor performance as well as poor robustness. 

The closed-loop bandwidth characterizes the transient response speed. Consider¬ 
ing the closed-loop system as a low-pass filter, larger bandwidth means faster response 
since high-frequency signals pass more quickly on the system output. However, as it 
is shown in Section 3.3, the increasing of the bandwidth also increases noises effect 
and parameter variations. 

The closed-loop bandwidth u>b is the highest frequency at which \ T( ja))\ crosses 
\/V2 = 0.707 -3 dBj from above. 

Alternative definition of the bandwidth may be given by using the sensitivity 
function S instead of T. 
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3.3 Trade-offs in the design of SISO systems 


MATLAB functions used in this section 


Function 

Description 

loopmargjttt 

Stability margins of closed-loop system 

pole 

Transfer function poles 

zero 

Transfer function zeros and gain 

bodemag 

Bode magnitude plot 


In this section, we discuss in brief the limitations on the performance of SISO 
systems which impose trade-offs in controller design. 

3.3.1 Limitations on S and T 

As shown by (3.7), the sensitivity S and the complementary sensitivity T of a SISO 
system satisfy 


S+T= 1. 

In the ideal case, S should be small for small tracking error and disturbance effect, 
and T should be small to reduce the measurement noise effect. Unfortunately, S and T 
cannot be made small simultaneously. For each frequency w either \S( joj)\ or | T(jw) 
should be greater than or equal to 0.5. This means that the shaping of the frequency 
responses of S and T should be done so as to achieve a compromise between the 
disturbance attenuation and noise suppression. 

The limitations on the sensitivity functions are clarified by the following result: 

(Bode’s integral formula). Suppose that the open-loop transfer function L(s ) has 
at least two more poles than zeros and let S(s) is the sensitivity function. If the open- 
loop transfer function has poles {/?,:; = I,... ,N P } in the right half-plane, then for 
closed-loop stability the sensitivity function must satisfy 

,00 , 00 , 

J In \S(jw)\doj = In ! 1 + da = n ^ Refo), (3.12) 

where Re(p,) denotes the real part of the pole p t . 

Equation (3.12) shows that if the sensitivity function is made small at some fre¬ 
quencies it should increase at other frequencies so that the integral of In |5'(yct>)| to 
remain constant. This implies that the controller design may be considered as a redis¬ 
tribution of the disturbance attenuation over different frequencies. If the disturbance 
attenuation is improved in some frequency range, it will worsen in other, a property 
which is frequently called waterbed effect. lfN p >0, then the sensitivity reduction 
area (In \S(joj)\ < 0) is less than the sensitivity increase area (In |S(jco)| > 0) by an 
amount proportional to the sum of the distances from the right half-plane poles to the 
imaginary axis. This indicates that a portion of the loop gain which could otherwise 
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contribute to sensitivity reduction must instead be used to pull the unstable poles into 
the left half plane [88], 

Similarly to (3.12), it is possible to prove the following result in respect to the 
complementary sensitivity function T: 


[ 




Re(z ; )’ 


(3.13) 


where N z is the number of right half-plane zeros. On the basis of (3.12) and (3.13), 
one may conclude that fast right half-plane poles (larger Re(p,)) are worse than slow 
ones and slow right half-plane zeros (smaller Re(z / )) are worse than fast ones. 


3.3.2 Right half-plane poles and zeros 

The plant poles and zeros, especially those in the right half-plane (unstable poles 
and nonminimum phase zeros), may have a strong impact on the closed-loop system 
dynamics. As it is well known from the classical root locus analysis, when the open- 
loop gain tends to infinity, then the closed-loop poles tend to open-loop zeros. That is 
why the presence of nonminimum phase zeros causes instability for large gains. Very 
dangerous are the small in module nonminimum phase zeros which limits strongly 
the closed-loop bandwidth and hence the speed of closed-loop response. 

The analysis of the closed-loop dynamics leads to the following conclusions [43], 

• If the absolute value of the real part of the dominant closed-loop poles is greater 
than the smallest nonminimum phase open-loop zero, then the time response is 
characterized by large undershoot. That is why the closed-loop bandwidth should 
be set less than the smallest nonminimum phase zero. 

• If the absolute value of the real part of the dominant closed-loop poles is greater 
than the absolute value of the smallest stable open-loop zero, then significant 
overshoot will occur. 

• If the absolute value of the real part of the dominant closed-loop poles is less than 
the absolute value of the largest unstable open-loop pole then a large overshoot will 
occur or the system error will change its sign quickly. That is why the closed-loop 
bandwidth should be set greater than the real part of each unstable pole. 

• If the absolute value of the real part of the dominant closed-loop poles is greater 
than the absolute value of the smallest stable open-loop pole, then an overshoot 
will again occur. 

The above considerations imply that the closed-loop bandwidth should lie 
between the larger unstable open-loop pole and the smallest nonminimum phase 
open-loop zero, i.e., 

max I p k \ < (o B < min Iz.l. 

Refot)>0 Re(z;)>0 1 

If this relationship is not satisfied, then the closed-loop system may have bad response. 
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Example 3.1. Influence of plant poles and zeros 

Consider a plant model given by 


The closed-loop poles are assigned to {— 1, — 1, — 1}. Then, the corresponding 
controller is 

K(s) = K c -— 
s-Pc 

The controller parameters are given in Table 3.1 for four cases of plant pole-zero 
configurations. The unit step responses for these cases are shown in Figure 3.8. 
From the responses obtained, it is possible to derive the following conclusions. 

Case 1 (Very small stable zero) It is seen that the transient response has a large 
overshoot. 

Case 2 (Nonminimum phase zero, stable pole) There is a large undershoot, due to 
the nonminimum phase zero. There is also a small overshoot due to the stable 
pole at -0.5. 

Case 3 (Nonminimum phase zero, small unstable pole) First, there is large under¬ 
shoot due to the nonminimum phase zero, then one can see significant overshoot 
due to the unstable pole. 

Case 4 (Small nonminimum phase zero, large unstable pole) In this case, the under¬ 
shoot is due to the nonminimum phase zero and the overshoot is due to the 
unstable pole. The overshoot is larger in comparison with Case 3, which is 
due to the fact that the unstable pole is on the right of the nonminimum phase 
zero. □ 

It is necessary to note that open-loop poles depend on the intrinsic dynamics of 
the system and can be affected by changing the plant construction. Unlike to this, the 
open-loop zeros depend on how the sensors and actuators are coupled to the states. 
The zeros can thus be affected by moving the sensors and actuators or by adding 
sensors and actuators [89]. 


Table 3.1 Controller parameters for different pole-zero configurations 



Case 1 

Case 2 

Case 3 

Case 4 


p = -0.5 

p = -0.5 

p = 0.2 

p = 0.5 


z= -0.1 

z = 0.5 

z = 0.5 

z = 0.2 

K c 

20.6250 

-3.7500 

-18.8000 

32.5000 

Pc 

18.1250 

-6.2500 

-22.0000 

29.0000 


-0.4848 

-0.5333 

-0.1064 

0.1538 
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Figure 3.8 Plant output for four pole-zero configurations 


3.3.3 Limitations imposed by time delays 

The effect of a plant time delay on the closed-loop performance is similar to the effect 
of a nonminimum phase zero. 

Consider a plant G{s) which involves a time-delay e~ rs and has not nonminimum 
phase zeros. From the Pade approximation of the time delay, 


1 — x/2s 
1 + x/2s’ 













































Performance requirements and design limitations 159 



it follows that the approximated plant has a nonminimum phase zero at 2/r. 
According to the recommendations given above, the closed-loop bandwidth should 
satisfy 



3.3.4 Limitations imposed by measurement noise 

As it was previously shown, the effect of measurement noise on the system output 
and control action is given by 

y = -Tn, (3.15) 

u = -KSn (3.16) 

It is seen from (3.15) that the deleterious effect of the noise on the system output may 
be attenuated if \T(jco)\ is small in the frequency domain where \n(jco)\ is significant. 
Since the noise is typically significant in the high-frequency range, it imposes an upper 
limit on the closed-loop bandwidth. 

It should be pointed out that the effect of the measurement noise on the plant 
input may be much stronger than its effect on the system output. This is illustrated in 
Figure 3.9, which displays typical characteristics of G and L. 

It follows from (3.16) that in the low-frequency range where \L\ = GK | is much 
greater than 1, the noise n u ~ — (1 / G)n in the control action does not depend on the 
controller K. However, in the high-frequency range where \L\ is much less than 1, 
n u & —Kn and if the controller gain is large this may lead to large amplification of 
the noise in control action. 
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It is seen from Figure 3.9 that the increase of the open-loop gain from L to L' 
is achieved at the price of increasing |AT| to \K'\, i.e., at the price of larger noise 
effect on the plant input. The noise intensity and its power increase not only because 
\K\ > \K'\, but also because the noise power is proportional to the bandwidth. 

When the noise is very large the actuators may saturate which leads to decreasing 
of the effective gain, the signal distortion increases and the system accuracy deteri¬ 
orates. That is why the noise effect on the actuator inputs should be restricted. This 
limits the open-loop gain by limitation of\K\. 

3.3.5 Limitations, imposed by disturbances 

According to (3.6), the effect of disturbance on system output is given by 
y = Sd. 

Assume that the disturbance d has significant power only in the bandwidth B d . In 
such case, it is desirable to have small values of |5'(_/ct>)| in the range B d . This implies 
S(j(d) ~ 0 and T( joj) ~ 1 in this frequency range. 

Therefore, to achieve acceptable closed-loop performance in the presence of 
disturbances, it is necessary to set a lower limit on the closed-loop bandwidth. 

3.3.6 Limitations on control action 

In real systems, all actuators have constraints on the maximum output in the form of 
amplitude or rate saturation. Peaks of the control action occur as a result of fast changes 
of reference, disturbance or noise. As shown by (3.5), for one degree-of-freedom loops 
the controller output is given by 


u = KS(r -d-n). 


Since KS = T/G, we have that 

u=L( r -d-n). (3.17) 

It follows from (3.17) that if the closed-loop bandwidth is much larger than this 
of the plant G(s), then the transfer function K(s)S(s) will amplify significantly the 
high-frequency components in r(jco), d(joj), and n(jcd). 

Example 3.2. Large magnitude of control action 

Consider a plant and controller given by 


G(S) (25+l)(0.55+l)’ 


K(s) = 


9(0.45 + 1) 


0.35 + 1 
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Figure 3.10 Magnitude responses of plant, closed-loop system, and control 
sensitivity 


The sensitivity of control action to reference, disturbance, and noise is determined by 
the transfer function 


K(s)S{s) = 


m 

G(s) 


3.6s 3 + 18s 2 + 26.1s + 9 
0.3s 3 + 1.75s 2 + 6.4s + 10 


The magnitude responses of plant, closed-loop system, and control action sensi¬ 
tivity (determined by \K( ja>)S(jaj)\ = \T( joj)/G( joj)\) are shown in Figure 3.10. It 
is seen that the closed-loop bandwidth is about ten times larger than the plant band¬ 
width. This leads to high sensitivity of control in the high-frequency range that results 
in large picks of the control action in presence of high-frequency components in the 
reference, disturbance, or noise. □ 

In this way, we may conclude that to avoid actuator saturation, it is necessary to 
put an upper limit on the closed-loop bandwidth. 


3.3 .7 Limitations due to model errors 

Usually, the controller design is based on the nominal plant model after that one 
adds the requirement the resulting closed-loop performance to be insensitive to the 
difference between the actual and nominal model. This property of the closed-loop 
system is referred to as robustness. The closed-loop robustness in the presence of 
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different kind of uncertainties is investigated in more details in Sections 3.7 and 3.8. 
Here, we consider in simplified form the effect of unstructured perturbations on the 
closed-loop dynamics. 

As shown in Chapter 2, for a SISO system, the modeling errors due to 
unstructured uncertainty may be expressed as 

y(s) = G(s)u(s) = G nom (s)( 1 + G a (s)), 


where G„ om (s ) is the nominal plant model and G A(S ) is the model multiplicative error 
given by 


Gfs) 

' G nom (s) 


G(s) - G„ om (s) 
G nom (s) ■ 


The difference between nominal and actual model may be expressed also as a 
difference between nominal and actual closed-loop sensitivity. If we denote by 


Snomis) = 


1 + G nom (s)K(s) 


the nominal sensitivity function then in the presence of model errors the actual 
sensitivity one obtains 


S(s) = S nom (s)S A (s), 


where 

Sa(S) = 1 + T nom (s)G A (s) ’ 

Usually, the nominal model represents the plant behavior with sufficient accuracy 
in the low-frequency range, i.e., in the case when the plant input is constant or 
slowly varying. The modeling accuracy deteriorates as frequency increases since the 
dynamics features which are neglected in the nominal model, become considerable. 
This implies that \G A ( joj)\ will become more substantial with frequency increasing. 
Therefore, to achieve acceptable performance in the presence of modeling errors, it 
is necessary to put upper limit on the closed-loop bandwidth. 

We may summarize that in the controller design of SISO systems, it is necessary 
to make trade-offs which are determined by the following fundamental limitations. 

Snomis) = 1 - T„ om (s ) 

i.e., the disturbance is rejected only at frequencies for which \T{ja>)\ ~ 1. 

y(s) = ~T nom (s)n(s ) 

i.e., the measurement noise n(t) is suppressed only at frequencies for which 

\nm * o. 

T (s) 

u(s ) = ”° m r \\ r(s) - d(s) - n(s)) 

G(s ) 

i.e., large control actions occur at frequencies where \T(ja)\ « 1 but 

\G(ja))\ <5C 1, which takes place when the closed-loop system is much faster 

than the plant. 
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S(s) = S nom (s)S A (s) where S A (s) = \ 

1 + T„ om (s)G A (s) 

i.e., fast response to reference and disturbances at frequencies where the model 
is inaccurate jeopardize the closed-loop stability; note that the relative mod¬ 
eling error G A (s) usually has magnitude and phase which increase in the 
high-frequency range. 

Forcing the closed-loop to become faster than the nonminimum zeros leads to larger 
undershoots in the closed-loop response. 

It is necessary to stress that these design trade-offs are independent on the 
methods, used in controller design. 


Example 3.3. Tradeoffs in controller design 

The following example illustrates some of the tradeoffs in controller design. 

Consider the system shown in Figure 3.1 with a second-order plant described by 
the transfer function 
g _ K 0 

ry + 2t;T 0 s + i 

where K 0 = 10, T 0 = 1, and f = 0.5. 

As controllers, we shall make use of three lead compensators with different gains: 


Ki 


2 


TlS + 1 
T 2 S + 1 


,K 2 = 5 


T\S + 1 
Z 2 S+ 1 


, W 3 = 10 


t 2 s + 1 


where = 1, x 2 = 0.02. 

The Bode plots of the closed-loop systems with the three controllers are shown 
in Figure 3.11. It is seen that the largest closed-loop bandwidth corresponds to the 
highest gain controller (the third controller). 

The output closed-loop responses corresponding to the controllers K\,K 2 , and 
K 3 are displayed in Figure 3.12. With the increase of controller gain, the rise time 
decreases but the overshoot increases as well. Note that further increase of the 
controller gain may lead to closed-loop instability. 

The control actions produced by the three controllers are presented in 
Figure 3.13. The fastest response for the third controller is obtained at the price of the 
largest control impulse at the initial moment. Such impulses may lead to saturation 
of the actuators and bad performance of the closed-loop system. 

The magnitude responses corresponding to the output sensitivity functions are 
shown in Figure 3.14. For the highest gain (the third controller), the corresponding 
sensitivity function has the smallest value (—40 dB) in the low-frequency range up 
to 1 rad/s, which means that the disturbances with spectrum in this range will be 
suppressed 100 times when this controller is used. 

The transient responses to sinusoidal disturbance with unit magnitude and fre¬ 
quency 0.2 rad/s are shown in Figure 3.15. The response has a magnitude equal to 
0.01 in the case of the third controller, as predicted from the frequency analysis of 
output sensitivity function. 
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Closed-loop Bode plots 



Frequency (rad/s) 


Figure 3.11 Bode plots of the closed-loop systems 


Closed-loop unit step responses 



Time (s) 


Figure 3.12 Closed-loop transient responses 
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Figure 3.13 Controller outputs for unit step reference 
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Figure 3.14 Output sensitivity functions 
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Time (s) 

Figure 3.15 Output response to sinusoidal disturbance 


Consider finally the effect of measurement noise on the system behavior. The 
measurement noise is generated with the random number generator rand, has a zero 
mean value and standard deviation equal to 5.8 x 10 -3 . 

It is seen from the transient responses, presented in Figure 3.16, that the mea¬ 
surement noise has the largest effect in the case of third controller (highest gain). This 
follows also from the magnitude responses of the complementary sensitivity function 
(Figure 3.11), which is equal up to the sign to the noise transfer function. 

The measurement noise may lead to large noise at the plant input, so as to cause 
actuator saturation. For the example under consideration, the transfer functions of the 
closed-loop “measurement noise—plant input” are given by 

W\ = —K] S\, W 2 = -K 2 S 2 , W 3 = -K 3 S 3 

The magnitude responses of this loop for the three controllers are given in 
Figure 3.17. Clearly, the amplitude of the high-frequency noise at the plant input 
will increase with increasing of the controller gain. 

The closed-loop transient responses at the plant input, due to the measurement 
noise, are shown in Figure 3.18. For the third controller, the noise intensity at the 
plant input is several times higher than the intensity of the measurement noise and is 
significantly higher than the intensity of the noise at system output. □ 
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Figure 3.16 Output transient response due to the measurement noise 



Frequency (rad/s) 


Figure 3.17 Noise-to-plant input sensitivity functions 
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Figure 3.18 Transient responses at the plant input, due to the measurement noise 


The results obtained in this example lead to the following conclusions: 

• Higher controller gain leads to larger bandwidth and faster transient response of 
the closed-loop system. The steady-state error for higher gain is smaller. 

• Larger bandwidth leads to better suppression of the low-frequency disturbances. 

• Larger bandwidth leads to amplification of the high-frequency noises. 

It should be stressed that these conclusions hold also for high-order plants. 
Unfortunately, higher gain and larger bandwidth may lead to high sensitivity to 
parameter variations, i.e., to pure robustness. That is why the controller design is a 
tradeoff between achievement of good performance (good suppression of disturbances 
and noises) and good robustness (low sensitivity to plant model uncertainty). 


3.4 MIMO closed-loop systems 

MATLAB function used in this section 


Function Description 

loopsens Sensitivity functions of closed-loop system 
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Figure 3.19 Block diagram of a MIMO system 


The block diagram of a MIMO negative feedback system is shown in Figure 3.19. 
The system consists of a MIMO plant G and a controller K upon which act the 
reference r, the sensor noise n, input plant disturbance d t , and output disturbance d. 
In the general case, all signals are represented by vectors and the transfer function 
matrices G and K have appropriate dimensions. 

With an eye on the further considerations, it is convenient to define the input 
loop transfer function matrix L, and output loop transfer function matrix L„, as 

Li = KG, L 0 = GK, 

respectively, where Z., is obtained when breaking the loop at the input of the plant and 
L 0 is obtained when breaking the loop at the output of the plant. The input sensitivity 
function is defined as the transfer function matrix from d t to u g , 

Si = (I+Li)-\ u g = Sidi. 

The output sensitivity function is defined as the transfer function matrix from d toy, 
S 0 = (I + L 0 )-\ y = S 0 d. 

The matrices of the input complementary sensitivity and output complementary 
sensitivity are defined respectively as 

T i = I-S t = L i (I + L i y\ 

T 0 = I - S„ = Lfl + L 0 )~ x . 

(The term complementary is used to emphasize that T is complementary to S, 
T = I — S.) The matrix / + Z, is called input return difference, and I + L 0 is called 
output return difference. 

It is necessary to point out that in the general case, the sensitivity functions and 
the loop transfer functions in respect to the input and output are different (S 0 f S n 
T 0 ± Ti, L 0 ± f). 

As in the SISO case, the determination of the loop transfer functions and 
closed-loop sensitivity functions in MATLAB may be done by the function 
loopsens. 
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It is possible to show that the closed-loop system satisfies the following 
relationships 


y = T 0 (r -n) + S 0 Gdi + S„d, 


(3.18) 

(3.19) 

(3.20) 

(3.21) 


r - y = s„(r - d) + T a n - S a Gd u 
u = S t K(r -n)- S t Kd - fd„ 
Ug = S t K{r -n)- S t Kd + S t d,. 


Since S t K = KS a , (3.20) and (3.21) may also be written as 
u = KS 0 (r - n) - KS„d - T t d h 
u g = KS„(r - n) - KS a d + S,d t . 

Equations (3.18) through (3.21) play fundamental role in analysis and design of 
MIMO control systems. For instance, (3.18) reveals that the effect of disturbance d 
on the system output (y) can be made “small” making the output sensitivity function 
S 0 “small.” In a similar way, (3.21) shows that the effect of the disturbance <:/, on the 
plant input (u g ) can be made small, making the input sensitivity S t small. 

For MIMO systems, one uses more frequently the matrices L„, S 0 , and T„, which 
for brevity sometimes are denoted as L, S, and T. For SISO systems, one has that 
L i= L 0 = L, Si = S 0 =S, % = T 0 = T. 

For a better performance, a MIMO system may incorporate two degree-of- 
freedom controller similar to the SISO case. 

Consider again the MIMO system shown in Figure 3.19. Let us regroup the 
external input signals into the feedback loop as W\ and W2 and regroup the input 
signals and controller as e\ and e2. Then, the feedback loop with the plant and the 
controller can be represented as in Figure 3.20. 

Assume that the state-space realizations for G and K are stabilizable and 
detectable. Then the negative feedback system in Figure 3.20 is said to be internally 
stable if the transfer function matrix 



(3.22) 



Figure 3.20 Internal stability analysis block diagram 










Performance requirements and design limitations 171 

from the inputs ( W\,W2 ) to the outputs (e\ , €2) is stable. The internal stability 
guarantees that for all bounded inputs (w\,w 2 ) the outputs (e\, e 2 ) are also bounded. 

It should be noted, that for certain controllers, the 2 x 2 block matrix in (3.22) 
may not be proper, even though G and K are proper transfer function matrices. This 
means that for some inputs (wq, w 2 ), the algebraic loop cannot be solved in respect to 
(e\, e 2 ) and the feedback loop is said to be ill-posed. Controllers with such property 
are excluded from further consideration. If either G or K is strictly proper, then 
well-posedness is assured. 

To check the internal stability it is necessary and sufficient to test whether each 
of the four transfer function matrices in (3.22) is stable. In the special case when G 
and K are stable, the internal stability is checked easily. 

Let G and K are stable. Then, the system shown in Figure 3.20 is internally stable 
if and only if (/ + GK)~ 1 is stable, or equivalently 

det[7 + G(jco)K(jco)\ £ 0 for each to . (3.23) 

Equation (3.23) represents a generalization of the Nyquist criterion to the stability of 
MIMO systems. 


3.5 Performance specifications of MIMO systems 

MATLAB functions used in this section 
Function Description 

norm (T, inf) ^o-norm of transfer function T 


Performance analysis in the MIMO case is more complicated than in the SISO 
case and makes use of the singular values of matrix frequency responses and the 
norm of system transfer function. 

3.5.1 Using singular values for performance analysis 

Consider the application of singular values to the performance analysis of MIMO sys¬ 
tem in Figure 3.19. It follows from (3.18) through (3.21) that the effect of disturbances 
and noises on the closed-loop dynamics depends on the magnitudes of the transfer 
function matrices G,K, S h S 0 , T h and T 0 . The magnitude of a transfer function matrix 
G in a given frequency range can be characterized by using the singular values of 
the corresponding frequency response matrix G(jcd). (Further on, the argument jw is 
skipped for brevity.) Let the singular value decomposition (SVD) of n x m matrix M 
is (see Appendix A) 


G=irzv I 


(3.24) 
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The column vectors of U, denoted by Uj, are called output directions of the plant. 
They are orthonormal, i.e., they are orthogonal and have unit length, 

\\UjW2 = 7m 2 + M 2 H -+ \Ujn \ 2 = 1 , 

u’/uj = 1 , u’/uj = 0 , i +j. 

In a similar way, the column vectors of V, denoted by vare orthonormal and are 
called input directions. The input and output directions are related through the singular 
values. To see this, (3.24) is written as GV = UY, which for the /th column yields 


(3.25) 


where ay is the /th singular value of G. In this way, if we consider an input in 
direction vj, then the output is in direction u r Since ||y, ||2 = 1 and 11 w y |12 = 1, we see 
that the /th singular value rr ; characterizes the gain of the matrix G in this direction. 
Equation (3.25) may be written as 


7j(G) = || GrVj || 2 = 


The largest gain for any input direction is equal to the maximum singular value 
„ IIGWII2 _ IIGV1II2 
llvilb 

and the smallest gain for any input direction is equal to the minimum singular value 


ct(G) = o k (G) = min 


\\Gd\\ 2 _ ||Gv t || 2 

\\d\\ 2 Hnll2 

where k = min{n, m). This means that for any input vector d it is fulfilled that 




(3.26) 


The frequency response plots of b(G) and o(G) may be considered as a gen¬ 
eralization of the magnitude plot of scalar transfer function to the case of transfer 
function matrix. Indeed, if G is a scalar transfer function, the frequency response 
of its single singular value coincides with the magnitude response |G|. For a given 
frequency, the maximum and minimum singular values may be considered as the 
maximum and minimum gains of the corresponding transfer function matrix. These 
makes them convenient in the performance analysis of MIMO systems. Note that the 
singular values cannot be used in the stability analysis since they provide information 
only for the gain but not for the phase. 

In MATLAB, the singular value plot of a transfer function matrix is obtained by 
the function sigma. 

The singular value plots of the output sensitivity and complementary sensitivity 
transfer function matrices of a sixth-order two-input-two-output system are shown in 
Figure 3.21. In the given case, the matrices have two singular values which are the 
maximum and minimum one. 
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Frequency (rad/s) 



Frequency (rad/s) 

Figure 3.21 Singular value plot of S 0 and T 0 


The SVD is useful in the analysis and design of systems with nonsquare trans¬ 
fer function matrices (systems with different number of inputs and outputs). If, for 
instance, we have a plant with more outputs than inputs, then the additional output 
singular vectors show in which directions the plant cannot be controlled. 
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3.5.2 M J oo Norm of a system 

Consider the system in Figure 3.22 with stable transfer function matrix G. To assess 
the system performance, it is useful to have a single number which characterizes the 
“gain” of G, i.e., the size of the output signal z(t) for an input signal w{t) with unit 
size. This gain is determined by using an appropriate system norm. For the aim of 
robustness analysis and design the relevant norm is the so-called norm. 

Further on the size of z(t) is evaluated by using the signal 2-norm 

\\mh = f \zi(T)\ 2 dr. (3.27) 

We assume that w(t) is an arbitrary signal which satisfies || w(t)|| 2 = 1. 

The norm is defined as 

!|G(s)||oo :=maxff(G(») (3.28) 


where for a fixed frequency co, 


rr(G(joj)) = max 


M’^0 \\w(jco)\\ 2 


is the induced matrix 2-norm of G(jco). From system point of view, it follows from 
(3.28) that the norm is the “peak” of the frequency response characteristics (the 

peak of the maximum singular value) over the frequency. Note that for a SISO system 
the maximum peaks of the sensitivity and complementary sensitivity functions, 


M s = max |5(y'<y)|, M T = max \ T( jcd)\. 


are related to the Mf norm by the relationships 


M s M t = \\T\\ 00 . 


The norm also has several interpretations in the time domain. This norm is 
equal to the induced (worst case) 2-norm in the time domain: 


IIGfcOHoo = max = max \\z(t)\\ 2 . 

MO¥=0 ||w(t)|| 2 Ilw(()ll2=l 


(3.29) 


In this equation, the worst case input signal w(t) is a sinusoid with frequency of and 
a direction which gives b(G(jaf)) as a maximum gain. 

The norm satisfies the multiplicative property 


M(j)*(j)IU < mwiuitoii, 


(3.30) 


which has important implications in robust control theory. 



Figure 3.22 System G 
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The norm also has interpretation in terms of the mathematical expectation 
of stochastic signals [82, Section 4.5], 

The computation of Mf norm of a system G(s) can be done graphically using 
the singular value plot of G(ja>) and the definition (3.28). This, however, may lead to 
errors in case of lightly damped system or when the frequency grid is not sufficiently 
dense. That is why to compute ||G(j)|| <)0 it is better to use the MATLAB function 
norm (G, ' inf ' ), which implements an iterative state-space procedure. 

Example 3.4. norm of a system 

Consider a 2 x 2 transfer function matrix 


G(s) = 


10(5+1) 1 

s 2 + 0.2s + 100 s+ 1 
s + 2 5(s+l) 


s 2 + 0.1s + 10 (s + 2)(s + 3) 


The singular values of G(jco) are shown in Figure 3.23. From the maximum 
singular value, we obtain that its peak value is about 34 dB, which corresponds to a 
value of the norm, equal to 50.12. A more accurate computation of the norm is 

done by the command line 

norm(G,'inf') 


40 

30 

20 

’| 10 
i o 
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-30 

10° 10 1 10 2 
Frequency (rad/s) 



Figure 3.23 Maximum and minimum singular value of G(jco) 

















176 Design of embedded robust control systems using MA TLA Bf/Simulinlf 


which produces 


50.2496 □ 

3.5.3 Hankelnorm 

The Hankel norm of a stable system G(s) is obtained when one applies an input \v(t) 
up to the moment t — 0 and measures the output z(t) for t > 0, w(t) being chosen so 
that to maximize the ratio of the 2-norms of these signals: 

7/,r ii^)iii^ 

\\G(s)\\h := max v (3.31) 

W( ° V/-oo W w ^)\\l di: 

Hankel norm is a type of induced norm from the past inputs to the future outputs. 

It is possible to show that the Hankel norm is equal to 

IIGOOIIff = Jp(PQ), (3.32) 

where p is the spectral radius (the maximum eigenvalue), P is the controllability 
Grammian and Q is the observability Grammian. (See Appendix B for the definitions 
of Grammians.) The corresponding Hankel singular values are the positive square 
roots of the eigenvalues of product PQ, 


(3.33) 


The Hankel norm and the norm are closely related. It may be shown that 


l|G(5)ll//^^<l|G(^)lloo<2^a,. 


(3.34) 


In this way, the Hankel norm is always less than (or equal to) norm, which is 
seen by comparing the definitions (3.29) and (3.31). 


3,6 Trade-offs in the design of MIMO systems 

MATLAB function used in this section 

Function Description 

s i gma Singular value plot of MIMO system 

In this section, we analyze the main limitations and trade-offs in the design of 
MIMO systems in terms of singular values of certain transfer function matrices. 
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3.6.1 Disturbance rejection 

Efficient disturbance rejection at the plant output (y) in the low-frequency range, 
where d and <7, are significant, requires 

d(S 0 ) <K 1 (for disturbance at plant output, d), (3.35) 

d(S„G) <5C 1 (for disturbance at plant input, d,). (3.36) 


In a similar way, good disturbance rejection at the plant input (u g ) requires 


a(Sj) <?C 1 (for disturbance at plant input, d t ), (3.37) 

d(SiK) «; 1 (for disturbance at plant output, d). (3.38) 


Equations (3.35) and (3.36) imply that 
q_(L„) > 1 , q_(GK) > 1 , 

^)« 1 ’ 

and (3.37) and (3.38) imply that 

a(Li) » I, o(KG) » 1, 

" (G_1)<<1 ’ ^)« 1 ’ 


(3.39) 

(3.40) 


(3.41) 

(3.42) 


Conditions (3.39) and (3.41) maybe considered as a generalization of the require¬ 
ment for high loop gain of SISO systems. They are obtained from (3.35) and (3.37) 
as follows. Since S„ = (I + GK)~\ S t = (/ + KG)~\ according to (A.20) we have 
that 


-< cr (*5 0 ) < -, 

a(GK) + 1 - v - o(GK) - 1 


if <L(GK) > 1, 


a {KG) + 1 


a (KG) - 1 ’ 


if a (KG) > 1. 


For simplicity, conditions (3.40) and (3.42) are obtained under the assumption 
that the transfer function matrices G and K are invertible. (The same conditions may 
be obtained in case of rectangular transfer matrices using the pseudoinverse.) This 
gives 

o(S 0 G) = a(jl + GK)~ X G) te d{K~j = if a(GK) » 1, 

d(SjK) = a {(I + KGf'K) sw 5 (G _1 ) = if a(KG) » 1. 

v(G) 


In this way, efficient disturbance attenuation at the plant output (y) requires large 
output loop gain q_{L a ) = q_(GK) » 1 in the frequency range where d is significant 
in order to suppress d and large controller gain q_(K) » 1 in the frequency range where 
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di is significant to suppress <7,. In a similar way, efficient disturbance rejection at the 
plant input (u g ) requires large input loop gain fr(L,) = q_(KG) » 1 in the frequency 
range where d t is significant for attenuation of <7, and large plant gain q_(G) 1 in 

the frequency range where d is significant for attenuation of d. Note that the later 
condition cannot be changed by the controller design. 

To summarize, disturbance rejection imposes a lower bound on the loop gains in 
the low frequency range. It should be stressed, however, that the loop gains cannot 
be made arbitrarily high in large frequency range. This makes necessary a trade-off 
between closed-loop performance and design limitations. 

3.6.2 Noise suppression 

Another basic requirement to the closed-loop MIMO system performance is the sup¬ 
pression of measurement noises. As mentioned earlier, large values of gfLfjco)) over 
a large frequency range attenuate the effect of the disturbance d but in the same time 
they increase the effect of n, since T 0 ~ 1 and the noise gets through over the same 
frequency range, i.e., 

y = Tfr -n) + S 0 Gdf + S 0 d « (r - ri). 

Usually, the noise n is intensive in the high-frequency range. As in the SISO case, the 
large loop gain outside of the bandwidth of G, i.e., o(L 0 (jco)) » 1 or ofLfjco)) » 1, 
while d(G(j(o)) <5C 1 may amplify greatly the noise in control action (u). In fact, in 
this case, we have that 7j ~ 7 and assuming that G is invertible it follows that 

u = SjK(r -n-d)- 7 )d, = TiG~\r -n-d)- T i( t, w G~\r -n-d)- d t . 
Since for w such that d(G(j(d)) <d. 1 one has 


it follows that the disturbance and errors are amplified in u when the frequency range 
exceeds the bandwidth of G. In a similar way, the controller gain a ( K ) should be small 
in the frequency range where the loop gain is small to avoid large control actions and 
actuator saturation. In such case, rr(7,( jap) <5C 1,5,- « 1, 7} 0 and 

u = SiK(r -n-d)- T l d l « K(r - n- d). 

3.6.3 Model errors 

Suppose that the plant model G is perturbed to (7 + A)G with A stable and assume 
that the nominal system is stable, i.e., the closed-loop system with A = 0 is stable. 
Then, the perturbed closed-loop system is stable if the polynomial 

det (7 + (7 + A)GK) = det (7 + GK) det (7 + AT 0 ) 

has no zeros in the right half of the complex plane. This implies that ATj, should be 
small or b{T 0 ) should be small at those frequencies where A is significant, typically 
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in the high-frequency range. This in turn implies that the loop gain d(L 0 ) should be 
small for these frequencies. The conclusion is that the model errors impose an upper 
bound on the loop gains in the high-frequency range. 

Note that more detailed analysis of closed-loop stability and performance in the 
presence of model errors is given in Sections 3.8 and 3.9. 

The presentation given in this section shows that good performance requires to 
satisfy the conditions 

a(GK) » 1, a (KG) » 1, a(K) » 1, 

in some low-frequency range (0, a>i) and good robustness and efficient suppression 
of the measurement noises requires to satisfy the conditions 

a(GK) « 1, a(KG) « 1, a(K) < M 

in some high-frequency range («/,, oo) where M is bounded. These design require¬ 
ments are shown in Figure 3.24 and can be interpreted in respect to the input loop 
(using the subscript i of the corresponding transfer function matrices) as well as in 
respect to the output loop (using the subscript o). 



Figure 3.24 Specifying the desired singular values of L, S, and T 
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3.7 Uncertain systems 


MATLAB functions used in this section 


Function Description 


lft Linear fractional transformations (LFT) 

1 f tdata M- A decomposition of uncertain system 


The presence of uncertain dynamics in the system model may lead to significant 
differences between the dynamics of nominal and perturbed system. The increasing of 
model errors gradually worsen the performance and ultimately may cause instability 
of the closed-loop system. For this reason, it is important to take into account the 
possible uncertainties during the controller design and to investigate their effect on 
the closed-loop behavior. What is needed first is to obtain the mathematical description 
of a closed-loop system with uncertain plant. 

As shown in Chapter 2, a plant with uncertainty (perturbed plant) G p can be rep¬ 
resented by a linear fractional transformation (LFT) given in Figure 3.25. The vector 
U\ is representing the inputs from uncertainty A and the vector Va is representing the 
outputs to uncertainty. The perturbed plant is described by 


G p = Fu(G 0 , A), 


(3.43) 


where F v stands for upper LFT. An equivalent representation with lower LFT F L is 
also possible. It is assumed that the block A is stable and its elements are scaled so 
that 

max <r(A(j(ii)) < 1. 

Note that the latter condition is equivalent to 

II A||oo 5 1. 

In case of unstructured uncertainty, the matrix A has no a special structure and 
represents a single “full” block. 



Figure 3.25 LFT representation of uncertain plant 
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The block diagram of a closed-loop system with uncertain plant G p and controller 
K is shown in Figure 3.26. 

To unify the representation of closed-loop systems with different structures, we 
shall make use of the standard block diagram given in Figure 3.27. The block denoted 
by P is the open-loop system and contains all known elements including the nominal 
plant model and the weighting functions. This block has three input sets: inputs m a 
from uncertainty, the reference, disturbance, and noise signals collected in the vector 
w and control actions u. Three output sets are generated: outputs y A to uncertainty, 
controlled outputs (errors) z, and measurements y. In this way, the uncertain closed- 
loop system is described by 

z = Fu(F l (P,K), A )w = F l (Fu(P, A ),K)w. 




Figure 3.27 Standard representation of uncertain closed-loop system 
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Figure 3.28 Block diagram for robustness analysis 



Figure 3.29 M- A loop 


In this section, our attention will be focused on robustness analysis. That is why 
the controller K may be considered as a known system element and absorbed in the 
structure of open-loop system. Denote by 

where the dimensions of M n conform with those of A. Then, the general block dia¬ 
gram shown in Figure 3.27 is reduced to the block diagram given in Figure 3.28, 
where 

z = F V (M, A)w = [ M 22 +M 21 A(7 - M n /k)- l M u \ w. 

When considering the robustness, we should take into account that the exogenous 
signals w do not affect the system stability. That is why in robust-stability analysis, 
we use the block diagram shown in Figure 3.29 neglecting the subscripts of M. The 
closed-loop system depicted in the Figure 3.29 is referred to as M- A loop. 

In MATLAQ the construction of LFT interconnections is done using the function 
lft and the M- A decomposition is obtained by the function If tdata. 


3,8 Robust-stability analysis 


Robust Control Toolbox functions used in this section 


Function 

Description 

norm(T,inf) 

^o-norm of transfer function T 

robuststab 

Robust-stability analysis 
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Figure 3.30 Closed-loop system with input multiplicative uncertainty 


3.8.1 Unstructured uncertainty 

The robust-stability analysis in case of unstructured uncertainty (“full” block A) can 
be done by using the so-called small gain theorem (see for instance [82, Section 9.2]). 
According to this theorem, the system shown in Figure 3.29 with stable M, is stable for 
all A with || A Hoc < 1, if and only if HMH^ < 1. This gives a simple robust-stability 
test if A corresponds to additive or multiplicative plant perturbation. 

Example 3.5. Robust stability in case of input multiplicative uncertainty 

Consider a closed-loop system with input multiplicative uncertainty shown in 
Figure 3.30 where the matrix W m is frequency dependent weighting function and 
A m is a “full” block A with || A m || 00 = 1. In this case, the uncertain plant is given by 

G p = G(I + A m W m ) 
and it is possible to show that 

M = - W m {I + KG)~ l KG = - W m T h 

where 7) is the input sensitivity function. As a result, the robust-stability condition is 
Halloo < 1. 

This condition is easily checked by using the MATLAB function norm. □ 

3.8.2 Structured singular value 

The robust-stability test in presence of structured uncertainties is much more com¬ 
plicated and relies on the using of the so-called SSV denoted by u(.). Further on, 
we shall assume the general case when the plant uncertainties include unstructured 
uncertainties, such as unmodeled dynamics, as well as parameter variations. Accord¬ 
ing to the mixed uncertainty model presented in Chapter 2, all uncertain parts can 
be combined in a block-diagonal matrix and the closed-loop system can be rear¬ 
ranged in the standard configuration shown in Figure 3.31. There exist two type of 
blocks: repeated scalar blocks and full blocks. The block dimensions are denoted by 
r\,... ,r s \m\,... ,my. Define the uncertain block A as 

A = {diag [Sf ri ,..., S s I rs , A,,..., A f ] : <5, e C, Ay e C m ^} , 


(3.44) 
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where fff l= , r, + J2j = i m j ~ n ar| d n is the dimension of A. The set of all matrices A 
is defined as Ac C” x ". The parameters 5, of the repeated scalar blocks can be real 
numbers only, if the corresponding uncertainties are real. 

The SS V is a function of the complex matrix M and the structure A . The definition 
of ii is done using the condition for stability of the loop shown in Figure 3.31. If the 
matrices M and A are stable, then according to Nyquist criterion (3.23), it is necessary 
to fulfill 

det(7 - M(jco)A(jco)) f 0 for each co. (3.45) 

This condition motivates to find the smallest structured perturbation A (measured 
in terms of <r(A)), which leads to 

det(7 - M(jco)A(jco)) = 0 

at some frequency co, i.e., to closed-loop instability. 

For M e C" x ”, the SSV p^{M) is defined as 

mi n (ct(A) : A e A, det(7 — MA) = 0}' (3-46) 

If there is no A € A such that det(I — MA) = 0, then p\(M) = f 0. 

In accordance with this definition, p A (M) is reciprocal of the size (measured in 
2-norm) of smallest A from the set A, which makes the matrix (7 — MA) singular. 
The SSV n may be considered as a strict estimate of robust stability in respect to the 
structured A with multiple perturbation blocks. 

Note that p.\(M) = 5-(M)whenA = C” x ” (the case of unstructured uncertainty). 
Thus /Xa(M) extends the notion of largest singular value to the case of structured 
uncertainties. 

For systems described by transfer functions, p is a frequency dependent function. 
It may be computed at each frequency substituting s = jco in the transfer function 
matrix and finding p for the constant complex matrix M(jco). 



Figure 3.31 Closed-loop system used to define p 
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From the definition of /x, it is possible to make the following conclusions: 

• The SSV is defined not in respect to a particular perturbation A, but in respect 
to a whole set A of perturbations with given structure. This means that /x does 
not depend on the specific values of <5, and A j, but on the block numbers s, f and 
their dimensions r ; , mj, respectively. 

• ji is a function of two variables: the complex matrix M and the structure defined 
by A . For a fixed matrix M, it is possible to obtain different values of /x depending 
on the different structures of A. Further on, the symbol A in the notation /Xa(AT) 
sometimes will be skipped. 

• Smaller values of /x mean better robustness. 

3.8.3 Robust-stability analysis with /x 

The SSV u is used as a tool for robustness analysis in the frequency domain. Let M(s) 
is stable transfer function and assume that A is a block-structure as in (3.44). Then, 
it is possible to prove the following result [82, Section 11.3]. 

Let fi > 0. The loop shown in Figure 3.32 is stable for all stable transfer function 
matrices A e A with max,,, cr( A( joj>)) < 1//S if and only if 

max iu.\(M(jco)) < fi. 

According to this result, the peak value of the frequency response of /x determines 
the size of perturbations that the loop remains stable against. 

If the uncertainty is normalized so that <r( A) < 1, the robust-stability condition 
is reduced to 

< 1, for each oo. (3.47) 

The condition (3.47) may be rewritten as 

/x(M( y'&>))rx ( A ( y w)) < 1, for each &>, 

which can be interpreted as a “generalized small gain theorem” that takes into account 
the structure of A. 

Except some simple cases, the SSV /x, which is a frequency dependent function, 
cannot be computed exactly. However, there exist efficient algorithms to determine 
upper and lower bounds on /x. That is why the conclusions about system robust 
stability should be done in terms of these bounds. Specifically, let the maximums 



Figure 3.32 Robust stability 
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along frequency of the upper and lower bound on the SSVs be denoted, respectively, 
by p u and Pi so that 

Pi < ds(ld( joj)) < p u , for each co. 

Then 

• The uncertain system under consideration is guaranteed stable for all structured 
uncertain matrices A with 

maxd(A (j(o)) < 1 /p u . 

• There exists a particular structured transfer matrix A with 

max a(A(ja>)) = ^ 

<o Pi 

that destabilizes the system. 

In addition, for the case of normalized uncertainty 

maxer(A(y'<x>)) < 1 

it follows that 

• If p u < 1, the system is robustly stable in respect to the modeled uncertainty. 

• If Pi > 1, the robust stability is not achieved. 

• If Pi < 1 and p u > 1, it is not possible to make sure conclusion about stability; it 
is possible that the system is not robustly stable. 


The quantity 



max,,, /x A (M(») 


may be considered as a stability robustness margin in respect to the structured uncer¬ 
tainty which is acting on M. A stability robustness margin greater than one means 
that the uncertain system is stable for all possible values of the uncertainty A. A 
stability robustness margin less than one implies that there exists certain allowable 
A that leads to instability. Using the bounds on /x, the upper bound sm u = l/Pi on 
stability margin is obtained as the reciprocal value of the lower bound of n and the 
lower bound smi = 1 /p u on stability margin is obtained in the same way from the 
upper bound on the SSV 

The main tool in Robust Control Toolbox for robust-stability analysis, based 
on computation of SSV, is the function robuststab. This function may be used 
for stability analysis of systems with unstructured, structured, or mixed uncertainty. 
The results of stability analysis are obtained in terms of upper and lower bounds 
on /x and on stability margin. The function robuststab produces also the struc¬ 
ture destabunc containing a combination of uncertain parameter values closest 
to their nominal values that cause system instability along with the destabilizing 
frequency DestabilizingFrequency at which the instability occurs. Note 
that the closed-loop poles migrate across the stability boundary (imaginary axis in 
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continuous-time systems, unit-disk in discrete-time systems) at the frequency given 
by DestabilizingFrequency. 


Example 3.6. Robust-stability analysis using fi 

Consider a SISO closed-loop system whose plant has uncertain parameters and 
unmodeled dynamics represented as input multiplicative uncertainty. The plant 
transfer function is 


G = 


k 

s{T\S+ \ ){T 2 s + 1) 


(1 + W m S), 


where k,T\, and T 2 are the uncertain parameters, <5 is complex uncertain element with 
| <51 < 1 and W m is an uncertainty weighting function. The nominal values of the plant 
parameters are k„ om = 0.4, T\ nom = 0.2 s, and T 2nom =0.1 s. The relative uncertainty of 
these parameters is 50 percent, i.e., k e [0.2 0.6], 7] e [0.1 0.3], T 2 e [0.05 0.15], It 
is assumed that the maximum possible uncertainty due to the unmodeled dynamics is 
2 percent in the low-frequency range gradually increasing to 100 percent at frequency 
8 rad/s and reaches 400 percent in the high-frequency range. The corresponding 
uncertainty weighting function obtained by using the command makeweight is 
4s + 0.6198 
m ~ s + 30.99 


In this way, the 4 x 4 uncertainty matrix A contains three scalar real blocks corre¬ 
sponding to the parametric uncertainties in k, T x , and T 2 and one scalar complex block 
8 corresponding to the unstructured plant uncertainty (the unmodeled dynamics). 
The system is equipped with a controller with transfer function 


which is determined so that to ensure stability and desired performance of the closed- 
loop system with nominal plant model. 

The system robust stability is analyzed by aid of the function robuststab 
taking as an input argument the complementary sensitivity T. The computed upper 
and lower bounds on (i are shown in Figure 3.33. The function produces the stability 
robustness margin bounds 


sm u = 1.4348, sm, = 1.3946 


that correspond to the ji bounds 


Pi = 0.6970, p u = 0.7170. 

It follows from the stability margin bounds that 


For the specified structure and uncertainty level, the closed-loop system is 
robustly stable (the lower bound smi of the stability margin is > 1). 

The system can tolerate uncertainties less than 139 percent of the specified 
uncertainties. 

There exists uncertainty of size 143 percent of the specified one, which 
destabilizes the system. 
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Frequency (rad/s) 

Figure 3.33 Upper and lower bounds of p. 


The conclusions about system robust stability are contained in the variable 
report. This variable includes also information about the sensitivity of the sta¬ 
bility robustness margin with respect to the uncertain elements. In the given case, 
the strongest effect on the stability margin has the uncertainty due to the unmodeled 
dynamics; the weakest effect has the uncertainty of the time constant T 2 . 

Substituting the destabilizing uncertainty destabunc in the complemen¬ 
tary sensitivity function by using the function usubs, it is confirmed that the 
resulting closed-loop system is unstable with a pair of unstable poles equal to 
0± 11.3258. □ 


3,9 Robust performance analysis 

Robust Control Toolbox functions used in this section 


Function 

Description 

robustperf 

Robust performance analysis 

wcgain 

Worst case gain 

wcmargin 

Worst case margin 
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Figure 3.34 Robust performance definition 


3.9.1 Using j± for robust performance analysis 

In presence of parametric perturbations, the effect of exogenous disturbances and 
noises on the system dynamics may increase significantly. That is why apart from 
robust stability, in case of uncertainty it is necessary to ensure acceptable perfor¬ 
mance of the closed-loop system. This leads to the idea of robust performance, i.e., 
performance which remains acceptable in the presence of uncertain parameters and 
signals. 

The performance of MIMO system can be characterized by the aid of the Mf- 
norm. Specifically, it is assumed that good performance is equivalent to 

IIco = ma xd(T(jco)) < 1, 

where T is some weighted closed-loop matrix transfer function, i.e., closed-loop 
transfer function in which participate certain weighting functions. In case of robust 
performance analysis of the uncertain system given in Figure 3.34, T is taken as 
the uncertain transfer function from w to z, so that T = F V (M, A). The quantitative 
characterization of the performance is related to the determination of the “size” of 
the Fu(M, A), where A takes all admissible values. More precisely, it is said that the 
LFT in Figure 3.34 achieves robust performance if it is stable for all perturbations 
A € A satisfying max,,, a(A(ja>)) < 1, and moreover, if \\F V (M, A)!* < 1 for all 
such perturbations. 

The idea of robust performance analysis is to connect the size of the closed-loop 
transfer function matrix to a robust-stability test. Let T be a given stable system 
with input dimension n w and output dimension n z . According to Nyquist criterion 
(3.23) and small gain theorem, it follows that || 71 ^ < 1, if and only if the feedback 
loop in Figure 3.35 is stable for each stable A F (s) (with dimension n w x n z ) satisfying 
||A f || < 1. Hence, a transfer matrix T is small (|| 71 ^ < fi), if and only if Fean toler¬ 
ate all admissible stable perturbations A F (with || A F || < 1 /fi) avoiding instability. In 
this way, the size of the transfer matrix may be determined using a robust-stability test 
which allows to reduce the robust performance problem to a robust-stability problem. 

According to the above considerations, it follows that \\F V (M, A)Hoc < 1 for all 
perturbations A e A satisfying max ra d{A{jco)) < 1, if and only if the LFT, shown 
in Figure 3.36, is stable for all A e A and for all stable A F satisfying 

max<7(A(ya>)) < 1 and max (j(A F { jo))) < 1. 
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IIM 


Stable for all HApH < 1 

Figure 3.35 Performance as robust stability 



Figure 3.36 Robust stability with augmented uncertainty 


But this is exactly a robust-stability problem for M subject to perturbation 
matrices in the form 


A p 


A 0 1 

0 A f J’ 


Hence, the robust-stability test was used on a larger problem computing 
li Ap (M( joj)) to determine bounds on the robust performance for the original prob¬ 
lem. This leads to the use of additional (fictitious) uncertain block and determination 
of the robust stability of the augmented system deriving conclusions about the robust 
performance of the original system T = F V (M, A). 

Suppose that the peak value of the frequency response of /x is equal to ft. This 
implies that for all perturbations A P e \ P satisfying max m d(Ap(jco)) < 1//3, the 
perturbed system is stable and || Fu(M, Ap)^ < fi. Moreover, there exists a particu¬ 
lar perturbation matrix A P e A P , satisfying max K d(A P (jco)) = 1/yS, which causes 
|| Fu(M, A/>)|| oo = P, or instability. 

As in the case of robust-stability analysis, the algorithms for computation of SSV 
produce upper and lower bounds on /x . Let the maxima with respect to the frequency of 
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the upper and lower bounds of the SSV / u, Ap (M) be denoted by p u and Pi, respectively. 
Then 

• For all uncertainty matrices A P e A P satisfying 

max ct( Ap(yV)) < 
w Pu 

the perturbed system is stable and || T- H ,(.s’)||oo < Pu- 

• There exists a particular perturbation matrix A P e A P satisfying 

maxd-(A P (jcd)) = \ 

“ Pi 

which causes either || 7’ zw (.y)|| 00 > /3/ or instability. 

For a performance requirement || 7k, (s) Hoc < 1 and normalized uncertainty 


the following conclusions hold. 

• If p u < 1, the system achieves robust performance for the modeled uncertainty 

(this includes also robust stability). 

• If Pi > 1, the robust performance is not achieved. 

Clearly, if p t < 1 and p u > 1, it is not possible to make a definite conclusion 
whether the system achieves robust performance. 

In the analysis of robust performance, similarly to stability robustness margin, 
one may introduce the notion of robust performance margin. This quantity shows 
the uncertainty level, up to which the system possesses specified performance. The 
performance margin pm is equal to the reciprocal value of the maximum in respect 
to frequency of the SSV p Ap (M), i.e., pm — \/p. The upper bound pm u and lower 
bound pmi on the stability margin are obtained by Pi and p u , respectively, as 

pm u = j, pm t = 1. 

The performance margin bounds are interpreted in the following ways: if pm u > 1, 
the system achieves robust performance for the modeled uncertainty; if pm u < 1, the 
robust performance is not achieved; if pmi < 1 and pm u > 1, it is not possible to 
make sure conclusion. 

Note that the robust performance margin is less than the robust-stability margin. 

In Robust Control Toolbox, the robust performance analysis is done by the func¬ 
tion robustperf. This function produces upper and lower bounds on the SSV 
Pa P (M) defined for the case of robust performance problem along with upper and 
lower bounds on the robust performance margin. The function robustperf pro¬ 
duces also the structure per fmargunc of uncertain element values leading to worst 
performance degradation. 



192 Design of embedded robust control systems using MA TLA B^/Simulin/f 


Example 3.7. Robust performance analysis using p. 

Consider again the control system described in Example 3.4. Let the main require¬ 
ments to system performance are to ensure reference (r) tracking with acceptable error 
(e) and limited the control action (t<) magnitude. According to the first requirement, 
the sensitivity function S, connecting e with r, should be sufficiently small in the 
low-frequency range (r is a low-frequency signal). According to the second require¬ 
ment, the transfer function KS connecting e with u should be sufficiently small. To 
account for both requirements, it is appropriate to use as a system performance index 
the quantity 



where W p are W u are weighting transfer functions. Let 


= 0.8 


s 2 + 185 + 50 
s 2 + 24 5 + 0.04 


(3.48) 


are chosen so that when the condition 



(3.49) 


is fulfilled, then the control system has desired performance, i.e., desired accuracy of 
reference tracking and limited magnitude of control action are ensured. 

The closed-loop system block diagram, used in the robust performance analysis, 
which involves the weighting functions W p and W u is shown in Ligure 3.37. In the 
given case 


r, lv = 


W P S 1 
W U KS \ * 


the output vector z contains the weighted “errors” and the input vector w being the 
reference r. 



Figure 3.37 Closed-loop system with performance requirements 
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The system model is composed using the function sysic. The nominal closed- 
loop system has J^o-norm equal to 0.8774, so that the condition (3.49) is satisfied 
and the closed-loop system achieves nominal performance. 

The robust performance is analyzed by means of the function robustperf in 
the frequency range [10 -3 10 3 ] rad/s. 

The computed upper and lower bounds on p Ap (M) are shown in Figure 3.38. The 
function produces the performance margin bounds 

pm u = 0.6691, pm t = 0.6656 
that correspond to the p bounds 
A = 1.4944, P u = 1.5023. 

Since pm u < 1, the performance requirement (3.49) is not satisfied for the given 
uncertainty, i.e., the system does not achieve robust performance. It follows from the 
results obtained that for uncertainty level less than 66.56 percent of the given one, 
the value of the performance index (3.48) is less than or equal to 1/0.6656 = 1.5023. 
Also, the analysis produces a combination of uncertain elements of level 66.91 percent 
of the given one, for which the value of (3.48) is greater than or equal to 1 /0.6691 = 
1.4945. 

Apart from the conclusions concerning system performance, the variable 
report, produced by robustperf, contains also information about the influ¬ 
ence of uncertain elements on the stability margin. The strongest influence in the 
given case has the uncertainty in coefficient k. 



10° 

Frequency (rad/s) 


Figure 3.38 Upper and lower bounds of p Ap (M) 
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The structure perfmargunc, also produced by robustperf, contains 
uncertainty element values, which correspond to worst performance degradation. 
Substituting these elements in the closed-loop transfer function by using the function 
usubs it is obtained that || — 1.4944 which is less than fi u as expected. □ 

3.9.2 Worst case gain 

The system performance may be assessed approximately by the maximum of the 
frequency response of the largest singular value (Jf^-norm) of the sensitivity or 
complementary sensitivity transfer function matrix. For uncertain systems, it is of 
interest to determine the largest value of this maximum for the allowed uncertainty. 
This value, representing the largest possible gain in the frequency domain, is defined 
as the “worst case” gain. Determining the maximum gain over all allowable values of 
the uncertain elements is referred to as a worst case gain analysis. 

In Robust Control Toolbox, the worst case gain of uncertain systems may be 
determined by the function wcgain. It calculates upper and lower bounds on the 
worst gain and determines a structure wcunc containing a combination of uncertain 
element values which maximize the system gain. The function wcgain also produces 
information about the sensitivity of the worst case gain in respect to the uncertain 
elements. 

Example 3.8. Worst case gain 

Consider the uncertain control system described in Examples 3.6 and 3.7. To deter¬ 
mine the worst case gain, we shall make use of the function wcgain with input 
argument the complementary sensitivity T. As a result, one obtains the following 
bounds on the worst case gain: 

Lower bound: 2.69342 
Upper bound: 2.69345 

The strongest influence on the worst case gain in the given case has the uncertainty 
due to unmodeled dynamics. 

In Figure 3.39, we show the magnitude responses corresponding to 30 random 
combinations of uncertainty values and compare them with the responses of system 
with worst case gain. 

The step responses for 30 random uncertainty values and for the worst case gain 
are given in Figure 3.40. 

It follows from the results obtained that the plant uncertainty can lead to signifi¬ 
cant degradation of closed-loop system performance. In the worst case, the transient 
response is very oscillatory with overshoot of about 43 percent and settling time which 
is almost seven times larger than this of the nominal closed-loop system. 

Similar results about the worst case gain are obtained if instead of the 
complementary sensitivity T one is using the sensitivity function S. □ 
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Figure 3.39 Random and worst case magnitude responses 



Time (s) 

Figure 3.40 Random and worst case step responses 
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3.9.3 Worst case margin 

Still another element of robust performance is the so-called worst case margin. Worst 
case margin defines the largest disk margin such that for all possible values of the 
uncertainty and all gain and phase variations inside the disk, the closed-loop system 
is stable (for a definition of the disk margin see Section 3.2). Thus, results from the 
worst case margin determination imply that the closed-loop system is stable for a 
given uncertainty set and would remain stable in the presence of an additional GM 
and PM variations in the specified input/output loop. 

In Robust Control Toolbox, the worst case margin is computed using the function 
wcmargin. This function calculates the combined worst case input and output loop- 
at-a-time GM/PM of the feedback loop consisting of the loop transfer matrix L(s) in 
negative feedback with an identity matrix. 

Example 3.9. Worst case margin 

It is instructive to compare the classical, disk, and worst case stability margins for 
the uncertain system considered in Examples 3.4-3.6. Note that the system plant has 
four uncertain parameters k,Ti,T 2 , and 5. 

The classical cm and disk margins dm are computed using the function 
loopmargin. As a result one obtains 


GainMargin 

GMFrequency 

PhaseMargin 

PMFrequency 

DelayMargin 

DMFrequency 

Stable 


8.9096 

9.7399 


1.9757 

0.6155 

1.9757 


GainMargin 

PhaseMargin 

Frequency 


[ 0.2725 3 . 6698 ] 
[- 59.5149 59 . 5149 ] 
4.0185 


While the classical GM and PM (computed for the nominal system) are 
8.9096= 18.99 dB and ±69.6771°, respectively, the disk margin shows that the 
closed-loop will remain stable for independent, simultaneous, GM variation up to 
0.2775 and 3.6698 = ±11.29 dB and PM variations of ±59.51°. 

The computation of the worst case margin by the function wcmargin produces 


wcmarg = 


GainMargin 

PhaseMargin 

Frequency 

WCUnc 

Sensitivity 


[ 0.7092 1 . 4099 ] 
[- 19.3078 19 . 3078 ] 
3.3001 
[lxl struct] 

[lxl struct] 
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The maximum allowable GM for all possible defined uncertainty ranges is up 
to 0.7092 and 1.4099 = ±2.98 dB and PM variations of ±19.3078°. In this way, the 
variations of the parameters k, T u T 2 , and <5 may lead to significant reduction of the 
closed-loop stability margins. □ 


3.10 Numerical issues in robustness analysis 

Robust Control Toolbox function used in this section 

Function Description 

mussv Computation of the structured singular value 


As demonstrated in the previous sections of this chapter, the robustness of an 
uncertain closed-loop system is characterized by the peak magnitude of the corre¬ 
sponding SSV ix. Since the exact value of p may be computed only in some special 
cases, guaranteed results about the robustness properties may be found by using the 
upper bound on the SSV That is why the reliability of stability robustness analysis and 
performance robustness analysis depends on the accuracy achieved in p computation. 
Example 3.10 demonstrates that for some systems the error in computed upper bound 
on p may be very large. 

Example 3.10. Numerical issues in computing p 

Consider a second-order system described by the differential equation 

+ fll % + U2y = blU ' ( 3 - 50 ) 
Let us assume that the coefficients a\ and a 2 have relative uncertainties p\ and 
p 2 , respectively, so that these coefficients may be represented as 

a\ = 0 i(l +p\8\), a 2 = d 2 (l ±<5|), |<$,| < 1. |S 2 | < I. 

where a \, a 2 are the nominal values of the corresponding coefficients. 

The block diagram of the uncertain parameter system is shown in Figure 3.41 
where 



Note that the matrices M\ and M 2 are not unique and other representations of the 
uncertain coefficients are also possible. 

Introducing the variables xi =y, x 2 = y, the system (3.50) may be described in 
the state space form 

x, = x 2 , 

x 2 = -a 2 *i - diX 2 Piu§i -p 2 u& 2 ± b x u, 

VS, = 01*2* 

ys 2 = 02*1 


(3.51) 
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Figure 3.42 M- A loop corresponding to robustness stability analysis 


For u = 0, the Laplace transform of (3.51) yields 


fc£]-H 


M^l 

Ml) J 


M(s) = 


s 2 + a\s + 02 s 2 + a\s + «2 

~Mi M2 

s 2 + a\s + a2 s 2 + a\s + 02 


The system (3.52) may be represented as the M- A loop shown in Figure 3.42, 
where 


In the given case the set A consists of all diagonal 2x2 matrices whose diagonal 
elements have values between -1 and 1. 
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To derive an analytical expression for the SSV p corresponding to stability robust¬ 
ness analysis, it is necessary to find an expression for det(7 - M(jco)A(jco)). As a 
result, we obtain 

det(7 - M(jaj)A(jco)) = (a 2 - co 2 +ja ] co +j8 ] d t p t aj) 

x (a 2 ~ co 2 +ja\a> + hdiPi) + jSihdidiPiPico ( 3 - 53 ) 

(a 2 — co 2 + jd\(o) 2 (d 2 - co 2 + jd\id) 2 

Setting det(7 — M(jaj)A(ja>)) = 0, we find that the M- A loop is unstable if the 
uncertainties <5| and S 2 satisfy 



Pi a 2 p 2 


Hence, the minimum size uncertainty which leads to instability of the system 
(3.50) is 


The maximum singular value of Amin is equal to max {|<5*|, | <5| | [ so that the exact 
value of p as a function of the frequency co is given by 


Pa(M) = 


1 

max {|^|, |^|}' 


(3.55) 


The comparison of the exact value of p determined by (3.55) and its upper 
bound, computed by the function mussv from Robust Control Toolbox, is done for 
three second-order systems with the following parameters: 


System 1 d\ = 2, a 2 = 20, b\ — 1 
System 2 d\ = 0.3, a 2 = 100, b\ — 1 
System 3 d\ = 0.1, a 2 = 190, b\ — 1 


For all systems, we assume relative uncertainties p\ = 0.5, p 2 = 0.5. 

The exact values of p, for the three systems, computed by (3.55), are shown in 
Figure 3.43. The values of ji do not exceed 0.5 so that these systems remain stable 
for all perturbations satisfying |<5i| < 2.0, \8 2 \ < 2.0. This is in accordance with 
the stability analysis of second order systems which are always stable for positive 
coefficients a\ and a 2 . 

The upper bounds of p for the three systems computed by mussv are shown 
in Figure 3.44. The accuracy of the bound for Systems 2 and 3 is very low, and 
according to the computed values, these systems are not robustly stable for the given 
perturbations. Of course, this is not true for the prescribed relative uncertainties. 
The large errors in the computed p upper bound arise because the corresponding 
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systems are lightly damped. The damping ratios f of the three systems are given in 
the table below. 



System 1 

0.2236 

System 2 

0.0150 

System 3 

0.0036 


It is seen from the table that the error in computation of /x upper bound increases 
with the decreasing of the damping ratio which leads to wrong conclusions about the 
system robustness. □ 

The numerical difficulties associated with the computation of /x may be removed 
if the optimization problem related to the determination of the upper bound of /x is 
solved by using a linear matrix inequality (LMI) solver. This allows to employ the 
methods of semidefinite programming to find more accurate upper bound of /x. The 
implementation of LMI solver is done by using the function mussv with the option 
' a'. With such option, the computed upper bound on /x practically coincides with 
the exact value of /x. 


3.11 Notes and references 

The material presented in this chapter is available in lots of sources. Thorough expo¬ 
sition of the classical control theory for SISO systems is done in several excellent 
textbooks such as Franklin, Powell, and Emami-Naeini [69]; Goodwin, Graebe, and 
Salgado [43]; Golnaraghi and Kuo [62]; Ogata [68]; Dorf and Bishop [90], An acces¬ 
sible introduction to feedback system theory is given in Astrom and Murray [89], 
The modem approach to the theory of SISO systems based on 0 methods is pre¬ 
sented in Doyle, Francis, and Tannenbaum [91]; Skogestad and Postlethwaite [87]; 
Helton and Merino [92], The limitations and trade-offs in the design of SISO sys¬ 
tems are discussed in depth in Freudenberg and Looze [88,93], Goodwin, Graebe, 
and Salgado [43]; Astrom and Murray [89]; Leong and Doyle [94]; Skogestad and 
Postlethwaite [87]; Lurie and Enright [95]; see also the paper of Astrom [96] and 
the discussion therein. The book of Seron, Braslavsky, and Goodwin [97] is 
entirely devoted to the fundamental limitations in filtering and control problems. 
The multivariable system theory based on frequency-domain methods is presented 
in several books, see, e.g., Callier and Desoer [98], Green and Limebeer [99], 
Maciejowski [100], and Skogestad and Postlethwaite [87]. The limitations in the 
design of MIMO systems are discussed in Zhou, Doyle, and Glover [82]; Good¬ 
win, Graebe, and Salgado [43]; Morari and Zafiriou [101]. The modem theory of 
robust control may be found in the books of Zhou, Doyle, and Glover [82] and 
its textbook version [102], as well as in the books of Green and Limebeer [99], 
Skogestad and Postlethwaite [87], Sanchez-Pena and Sznaier [103], Dullerud and 
Paganini [104], The practical stability robustness and performance robustness analysis 
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is based on the computation of SSV fx. As it was shown by Braatz, Young, Doyle, and 
Morrari [105], the computational complexity of /i calculation in case of mixed real 
and complex uncertainties is nonpolynomial hard. This suggests that in the general 
case, the volume of computations in determining /x depends exponentially on the 
problem size. Therefore, it is pointless to pursue exact methods for the calculation 
of fx even for medium-size problems (less than 100 real parameters). Efficient com¬ 
putational methods to determine upper and lower bounds on /x are proposed by Fan, 
Tits, and Doyle [106] and Young, Newlin, and Doyle [107,108]. A comparison of 
the available algorithms to compute lower bounds on the SSV is done by Roos and 
Bianic [109], 



Chapter 4 

Controller design 


The controller synthesis is probably the most difficult and time consuming stage of 
embedded control system design. In this chapter, we present the design and analysis 
of five different discrete-time controllers which may be implemented successfully in 
embedded systems. To compare the controller properties, they are applied in single 
precision to steer one and the same system, namely, the cart-pendulum system pre¬ 
sented in Chapter 2. This system has some peculiarities which lead to difficulties in 
the implementation of design methods. One of our primary goals is to investigate the 
behavior of the corresponding closed-loop systems in presence of plant uncertainty. 

As is discussed in Chapter 1, the design of discrete-time controllers can be carried 
out in two distinctly different ways. One is to design the controller in continuous-time 
and then to derive a discrete version of it. The alternative method is to discretize the 
continuous-time plant model and perform the design in discrete time. In this chapter, 
we adopt the second approach. The performance specifications are usually formulated 
in continuous-time due to the clear physical interpretation in this case. After plant 
discretization, a discrete-time controller is computed which may be implemented 
directly for simulation or real-time control. Using such approach avoids the errors 
which might be introduced in converting a continuous-time controller to discrete time. 

The controllers considered in this chapter are chosen somewhat subjectively, but 
we tried to include regulators which are proven in practice. They are described in order 
of their increasing complexity and robustness. First, we discuss the properties of the 
classical proportional-integral-derivative (PID) controller which is widely used due 
to its simple implementation although it is not sufficiently robust to plant variations. 
Next, we present a linear quadratic Gaussian (LQG) controller that involves linear 
quadratic regulator (LQR) and uses state estimate obtained by Kalman filter. When 
applied to the case of colored noises, the LQG controller design may be associated 
with some numerical difficulties which are briefly discussed. Similar performance 
has a controller comprising LQR and filter. These three controllers are designed 
based on performance requirements formulated in the time domain. It is shown then 
that better results in respect to the robustness of the closed-loop system are obtained 
by applying controller or /i regulator which are designed by using performance 
specifications in the frequency domain. Finally, we present the results from hardware- 
in-the-loop (HIL) simulations of the five controllers. 

In our presentation, we do not discuss the implementation of state regulators and 
state observers designed by pole assignment since, in authors’ opinion, they cannot 
ensure always the necessary closed-loop performance and robustness. Also, we do 
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not include description of robust loop shaping procedures which are considered in 
detail in [50,110], Other design methods are described in the notes and references 
given at the end of the chapter. 


4,1 PID controller 


MATLAB® files used in this section 

File 

Description 

PID_controller_design.m 

discrete_PlD_pendulum.six 

unc_lin_model.m 

sim PID pendulum nominal.m 

clp PID pendulum.six 
PlD_robstab.m 

PID_wcp.m 
sim_MC_PID.m 

PID_controller_open_loop.six 

Design of PID controller 

Evaluates optimization performance index 
Generates outputs and control for optimization 
Generates the uncertainty cart-pendulum model 
Simulation of nominal system 

Simulink® model of closed-loop system 
Robust-stability analysis 

Frequency responses and worst gain analysis 
Monte-Carlo simulation 

Simulink model of PID controller for open 
loop connection 


Due to its simplicity and clear physical interpretation, the PID controller and its 
modifications are the most widely used in practice control algorithms. Usually, they 
are implemented in single embedded devices and/or in industrial factories with dozens 
of controllers. There is a large amount of literature dedicated to methods for design 
of PID controllers for both single-input-single-output (SISO) and multiple-input- 
multiple-output (MIMO) plants. In case of MIMO plant, the PID controller tuning 
becomes a difficult problem because of interactions between different inputs and 
outputs. For such plants, the most common used control scheme is the decentralized 
PID control. Unfortunately, it has some disadvantages when one should control non¬ 
minimum phase or unstable plant with more outputs then inputs (plant with rectangular 
transfer matrix). In this case, optimization approach can be used for PID controller 
timing. The main advantages of this approach are that it may be used with linear or 
nonlinear MIMO models, and the numerical optimization can be done with many 
different combinations between optimization methods with performance indices. The 
main disadvantage is that the robust stability and robust performance of control system 
are not guaranteed. 

In this section, we present the optimization approach for PID controller tuning. 
The controller aim is to ensure accurate reference tracking and regulation in presence 
of disturbances and noises. It is shown that the PID controller ensures nominal control 
system performance but cannot guarantee good performance when plant model varies. 

The basic configuration of closed-loop system with PID controller is shown in 
Figure 4.1. The PID controller design may be presented briefly as follows. Assume 
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Figure 4.1 Closed-loop system with PID controller 


that the time-invariant plant is described by the differential state and algebraic output 
equations 


x{t)=f(x,u,v,t), 
y(t) = h(x,u,w,t). 


(4.1) 


where x(t) is the state vector, y(t) is measurement vector, and v(f), w(t) are the 
process and measurement noises, respectively;/(•), /*(•) are smooth nonlinear func¬ 
tions. In design procedure, both the deterministic model, obtained from (4.1) for 
v{t) = 0, w(t) = 0 and the model with noises (4.1) can be used. Note that, the linear 
stochastic or deterministic state space model can be used instead of the model (4.1), 

x(t) = Ax(t) + Bu(t) + v(t), 

y(t) = Cx(t) + w(t), ' ' ; 


where A,B, C, and D are constant matrices with appropriate dimensions. The model 

(4.2) can be obtained by linearization of model (4.1) or by the identification methods 
described in Appendix D and Chapter 2. 

The PID controller is described by the equation 

u{t) = K p (e(t) + y < r ) dr + T d, (4.3) 

where e(t) = r(t) — y(t) is the error; K p , T u and T d are the proportional gain, integral 
time constant and derivative time constant, respectively. After Laplace transform, 

(4.3) takes the form 

u(s) = K p (e(s) + ^-e(s) + T d se(s)J . (4.4) 

The controller (4.4) is idealized one and cannot be implemented in practice. Some 
modifications should be performed to obtain useful for practical implementation 
controller. A drawback of the derivative term of (4.3) is that it has high gain in high 
frequencies. This means that measurement noise will generate large variations of 
control signal, which is undesirable for the actuators. This effect can be reduced by 
implementation of first-order low-pass filter derivative term NT d s/(s + N) instead of 
the ideal term T d s. Large value of the filter pole N means high cut-off frequency. 
Ideal derivative term is obtained for N ->• oo. Typically, N takes the value in range 2- 
100. Other significant drawback in practical implementation of ideal PID controller is 
the so-called integrator windup. This situation arises when the control signal reaches 
the actuator limits (note that we always have actuator limits, e.g., the valve cannot 
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Figure 4.2 PID controller with low pass filter in derivative and antiwindup 


be more than fully opened or fully closed and the electrical drive has limited speed). 
Then, the control signal remains at its limit independently of plant output as long 
as the actuator remains saturated. The integral term is also build up since the error 
is nonzero. The controller output and the integral term may become very large. The 
control signal then will remain saturated even when the error changes, and it takes a 
long time before the controller output fall back in saturation range. The consequence 
is that a large deviation of plant output from reference can occurred and the settling 
time becomes very large. This situation is known as integrator windup. There are many 
methods to reduce the windup effect. One useful method is illustrated in Figure 4.2, 
where the PID controller has an extra condition feedback. The feedback forms the 
signal which is the weighted difference between the PID controller output u(t) and 
output of actuator saturation mathematical model u sat (t). 

Thus, the useful in practice PID controller with first-order low-pass filter in 
derivative term and antiwindup algorithm is described by 

( T,Ns \ 1 

e(s) + -^-y-Ms) + (K p K ie (s) - k w v(s))-, (4.5) 

s + N ) s 

where K, = 1 /7) is the integral gain, k, v is the condition feedback gain, and v(s) = 
u(s) — u sat (s ) . The signal v is zero when there is no saturation and then condition 
feedback has not effect on the control system. When the control signal saturates, the 
signal v(s) is subtracted from the error e(s) before its integration. In this manner, 
the integral term value and controller output are decreased, and the windup effect is 
reduced. The rate at which controller output is reset depends of condition feedback 
gain k w . The large value of k w ensures fast reset of integrator, but k w cannot be too large 
because then the measurement noise can cause an undesirable reset or oscillations 
with constant magnitude equal to the difference between the upper and the lower 
limits of actuator saturation mathematical model. A usual choice of k w is as a fraction 
of 1/7). 

In embedded control systems, PID controller algorithm is implemented in digital 
microcontroller. For this reason, algorithm (4.5) must be converted to discrete-time 
form. There are many technics for discretization of PID controller terms. Here, we use 
backward Euler method for discretization of filtered derivative term and forward Euler 
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method for discretization of integration term. Thus, the description of discrete-time 
PID controller is given by 

U (z) = K p (e(z) + ^ ] e(z ^ + ( Kp K ie(s ) - k x v(z)) z 3 |4 ( 4 - 6 ) 

where v(z) = u(z) — u sat (z). 

The PID controller design problem for system (4.1) or (4.2) consists of finding 
appropriate values of parameters 0 = \K p ,K t , T d , N, /c w ] which ensure the desired 
control system performance. In case of MIMO plant, we should find the values of 

<t> = [Kp n ,K hl ,T dn ,N 1 uk wn ,Kp 2l ,K i2l ,T d2i ,N 2 uk W2l ,..., 

K Prm > K im> - T d rm > ^rm, 

where K Pij , K iy , T dj/ , Ny , k Wj are the parameters of PID controller between z'th plant 
output and /th plant input. 

After the optimization of PID regulator parameters, we should test robust stability 
and performance of control system with the obtained optimal parameters. The most 
frequently used performance index is 

4>) + E ® TRu <!’ 0)> ( 4 - 7 ) 

where Q and R are symmetric positive semidefinite matrices with appropriate dimen¬ 
sions. The diagonal elements of matrices Q and R may be chosen in accordance to 
the relative significance of components of error signal and control signal. For exam¬ 
ple, if the designer knows that the error between reference signal and first output is 
more significant than other errors, then the element Q( 1,1) should be chosen to be 
large relative to other elements of Q. Often, the matrix R is chosen as R = pi, p > 0. 
Then, large value of coefficient p means large relative weight of the control signal in 
performance index (4.7), which ensures control signals with small magnitudes and 
slow transient responses. The optimal PID controller parameters are obtained as 

4> opt = min J(<p). (4.8) 

0 

The performance index can be minimized by wide variety of classical and con¬ 
temporary optimization methods. When a nonlinear plant model is available and/or the 
objective function has several local minima, methods for global optimization are used. 
For example, methods as simulated annealing, pattern search, simulated annealing, 
and genetic algorithms (GAs) are especially useful. The GA is a method for solv¬ 
ing optimization problems that is based on natural selection, the process that drives 
biological evolution. The GA repeatedly modifies a population of individual solu¬ 
tions. At each step, it selects individuals from the current population to be “parents” 
and uses them to produce the “children” for the next generation. Over successive 
generations, the population “evolves” toward an optimal solution. The GA mainly 
differs from classical optimization algorithms in two ways: it generates a population 
of points at each iteration. The best point in the population approaches an optimal 



208 Design of embedded robust control systems using MATLAB®/SimulinKf 


solution; it selects the next population by computation which uses random number 
generators. Other advantage of GA is that the initial population is created by uniform 
random generator. Thus, the designer is not obliged to set the initial PID controller 
parameters. Due to random generation of initial population, it is recommended to run 
several times the optimization procedure. Then one can use the best solution obtained. 


Example 4.1. Design of PID controller for the cart-pendulum system 

Consider the design of a PID controller for the cart-pendulum system presented in 
Chapter 2. The block diagram of the closed-loop system comprising the plant and the 
PID controller is shown in Figure 4.3. The cart position and the pendulum angle are 
measured by 12-bit encoders which generate measurement noises wi and w 2 . 

The state-space equations describing the fourth-order continuous-time plant are 


m =f(x,u,t), 
y{t) = h(x,w,t). 


(4.9) 


wherex(t) = [p, 9, p, 6] ,y(t)=\p, 6] T ,w(t) = [wf t), w 2 (t)] r , andp(t),p(t), 
9(t), 9(t) are the cart position, cart velocity, pendulum angle, and pendulum angular 
velocity, respectively. The functions in model (4.9) are given by 


P 


f(x,u,t) = 


m 2 l 2 g sin (6) cos (6) — mll t 9 2 sin (9) — I t f c p —f p lm cos (9)9 + I t k F u 
den 

M t mlg sin (9) — m 2 l 2 sin (9) cos (9)9 2 —f c ml cos (9)p 
den 

f p M,9 + ml cos (6)kfU 


h(x,w,t) 


P 

'1 0 0 0 ] e 

_0 1 0 oj p 

9 


w,(t)l 
_w 2 (t)\ ’ 


where I, = I + ml 2 , M, = M + m, den = M t I t — ml 2 , and the plant parameters with 
their tolerances are given in Table 4.1. 



Figure 4.3 PID controller of cart-pendulum system 
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Table 4.1 Cart—pendulum model parameters and tolerances 


Parameter 

Description 

Value 

Units 

Tolerance (%) 

m 

Equivalent pendulum mass 

0.104 

kg 


M 

Equivalent cart mass 

0.768 

kg 

±10.0 

l 

Distance from the base to the 
system center of mass 

0.174 

m 


I 

Pendulum moment of inertia 

2.83 x 10" 3 

kgm 2 

±20.0 

fc 

Dynamic cart friction coefficient 

0.5 


±20.0 

fp 

Rotational friction coefficient 

6.65 x 10" 5 

N ms/rad 

±20.0 

kp 

Control force to PWM signal ratio 

9.4 

N 



The designed PID controller has three inputs and one output. The first input is 
cart-position error, the second one is the pendulum angle, and the third is the differ¬ 
ence between the controller output u and output of actuator saturation mathematical 
model u sat . The control signal is set up by the following equation: 


K Ppos T dpos N pos (z - 1) 
(1 + N pos T s )z - 1 


-K pe 

T s 

K pe T de N e (z - X) 
(1 + N pos T s )z - 1 




e(z), 


(4.10) 


where e(z) = [e p ,Jz)6(z)v(z)] r , e pos (z ) = r pos (z ) - p(z) is the cart position error, 
T, = 0.01 s is the sampling time, K pe ,K ie ,T de ,N 0 ,K Ppos ,T dpos ,N pos are the coeffi¬ 
cients of multiple-input-single-output PID controller. As can be seen from (4.10), for 
stabilization of pendulum angle a PID controller with anti windup mechanism is used, 
whereas for control of cart position, a PD controller is implemented. The vector with 
controller parameters is set as 


= [K Pe ,K ie ,T de ,No,K Ppos ,T dpos ,N pos \. 


(4.11) 


The values of parameters contained in the vector </> are obtained by minimizing the 
performance index (4.7) for 


'1 0 0 " 

Q = 0 1 0 , i? = 0. 

0 0 0 


Due to the fact that we cannot set “good” initial value of vector <p and due to 
the nonlinearity of model (4.9), the minimization of performance index (4.7) is done 
by GA. Such algorithm is implemented in function ga of MATLAB Global Opti¬ 
mization Toolbox. Initial population of GA is created by random generator. Due to 
this fact, sometimes the algorithm can return local minima. This possibility decreases 
significantly if greater number of individuals is used and/or several runs of procedure 
are done. 
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The PID controller design for cart-pendulum system is done by the M-file PID_ 
controller_design which uses the MATLAB function ga. The fitness func¬ 
tion (4.7) is calculated by user-defined MATLAB function err_fun. m, whereas 
the cart-position error and pendulum angle are evaluated by the Simulink model 
discrete_PID_pendulum. six. Note that GA computes successively a fitness 
function for each individual in the current population. However, if the so-called vec¬ 
torized fitness function is used, than the algorithm runs very quickly owing to that 
the fitness function computation is done once simultaneously for all individuals in 
the current population. Fifteen runs of optimization procedure with initial population 
of 300 individuals and option “vectorized” for fitness function are performed. 

The values of PID controller parameters, performance index (4.7) and number 
of performed generations for each run of optimization are presented in Table 4.2. As 
can be seen in runs 1, 3, 8, 11, and 12 almost the same small values of performance 
index (4.7) are achieved, which is indication for successful minimization. For other 
runs, the fitness function values are large and optimization procedure does not reach 
global minima. Moreover, some of these solutions do not stabilize control system. 
In all runs optimization stops due to that the average change in the fitness value is 
less than prescribed tolerance, which means finding of global or local minima. The 
closed-loop system with parameters obtained in 1st, 11th, and 12th runs has real pole 
whose value exceeds 1 in the last decimal digit, for example, the closed-loop pole 
for system parameters obtained in 11 run is 1.000000000000003. Obviously, this is 
a numerical problem that can cause instability of closed-loop system if the controller 
will be implemented on a microcontroller. Thus, the parameters obtained in the 14th 
run are chosen as a solution of controller design task. The closed-loop system with 
PID controller is simulated by the Simulink file clp_PID_pendulum. six. 

The PID controller model is shown in Figure 4.4. Its implementation is done by 
single precision arithmetic taking into account that the controller will be implemented 
on a processor having floating-point unit. 


Table 4.2 PID controller design iterations 


Run 

n ge „ 




R p, 

K h 

T d„ 

N e 


Td pm 

N pos 

1 

171 

8.73 

x 

10 1 

2.77 

0.50 

0.25 

30.00 

-0.03 

0.35 

13.35 

2 

68 

1.61 

x 

10 8 

-7.87 

0.13 

7.07 

2.67 

10.63 

10.28 

28.70 

3 

83 

8.75 

X 

10 1 

4.85 

0.56 

0.13 

29.98 

-0.07 

0.09 

8.78 

4 

76 

1.61 

x 

10 8 

-9.70 

0.06 

3.93 

2.02 

8.75 

9.08 

29.14 

5 

138 

1.61 

x 

10 8 

3.76 

-0.12 

-7.44 

2.43 

4.70 

9.34 

29.19 

6 

70 

1.61 

x 

10 8 

-3.81 

0.12 

8.29 

2.50 

7.81 

7.50 

29.46 

7 

84 

1.61 

X 

10 8 

-7.98 

0.05 

2.82 

2.43 

8.37 

6.73 

28.80 

8 

126 

8.77 

X 

10 1 

6.08 

0.59 

0.09 

30.00 

-0.09 

0.00 

10.70 

9 

245 

1.19 

x 

10 8 

-8.72 

0.07 

-0.29 

18.03 

2.66 

3.11 

25.30 

10 

85 

1.61 

X 

10 8 

-5.02 

0.16 

8.39 

3.19 

9.02 

10.07 

29.35 

11 

166 

8.75 

X 

10 1 

5.28 

0.56 

0.12 

30.00 

-0.08 

0.07 

7.23 

12 

85 

8.76 

X 

10 1 

5.48 

0.58 

0.10 

30.00 

-0.08 

0.02 

30.00 

13 

109 

1.61 

X 

10 8 

-3.60 

0.17 

8.78 

3.19 

7.54 

9.06 

29.07 

14 

112 

6.30 

X 

10 3 

7.30 

9.63 

1.24 

21.49 

0.23 

-7.28 

14.66 

15 

112 

1.38 


10 3 

-8.13 

0.95 

-0.44 

13.42 

8.02 

2.07 

9.82 



Single precision PID controller with: 





Figure 4.4 Simulink model of PID controller with antiwindup 
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Cart position 



Figure 4.5 Cart position 

Pendulum angle 



Figure 4.6 Pendulum angle 


The results from simulation of nominal closed-loop system for step references 
of magnitude 0.5 m and -0.5 m are shown in Figures 4.5—4.7. Regarding cart posi¬ 
tion, the control system has good performance, the settling time is approximately 9 s 
and the overshoot is negligible. The deviation of pendulum angle is about 1 deg which 
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is sufficiently small, but it should be noted that the pendulum angle is affected by the 
noise due to quantization error. This noise can be seen in control action too, which is 
undesirable for the actuator. The noise influence of control action may be reduced by 
using a higher bit analog-to-digital converter (ADC) or by limitation of closed-loop 
bandwidth, or by filtration with optimal filters like Kalman filter and ,>Cq filter. 

The nominal control system has good performance, but the robust stability and 
robust performance are not guaranteed due to the used approach for PID controller tun¬ 
ing. A robust-stability analysis should be performed. The classical and disk stability 
margins are obtained as 


GainMargin: 
GMFrequency 
PhaseMargin 
PMFrequency 
DelayMargin 
DMFrequency 
Stable 


[0.131614125528137 1.298114244837111] 
[1.086189627370737 31.275983301257536] 
6.806361997034553 
26.389644674786840 
[0.450151672729292 1] 

[26.389644674786840 3.141592653589793e+02] 


GainMargin: [0.896753236434440 1.115133973729581] 
PhaseMargin: [-6.231460596250620 6.231460596250620] 
Frequency: 27.204496764576167 
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Robust stability 



Frequency (rad/s) 

Figure 4.8 Robust stability 


The gain margin of 1.298 deg and phase margin of6.806 deg are sufficiently large. 
Additional robust-stability analysis is done by M-file PID_robstab.m, which 
produces the report 

REPORT = 

Uncertain system is robustly stable to modeled uncertainty. 

— It can tolerate up to 125% of the modeled uncertainty. 

-- A destabilizing combination of 128% of the modeled uncertainty 

— This combination causes an instability at 31.3 rad/seconds. 

-- Sensitivity with respect to the uncertain elements are: 

'I' is 9%. Increasing 'I' by 25% leads to a 2% decrease 

in the margin. 

'M' is 0%. Increasing 'M' by 25% leads to a 0% decrease 

in the margin. 

'f_c' is 4%. Increasing 'f_c' by 25% leads to a 1% decrease 

in the margin. 

'f_p' is 0%. Increasing 'f_p' by 25% leads to a 0% decrease 

in the margin. 

The report shows that the control system is robustly stable. The peak value 
of structured singular value /i which corresponds to the robust stability, is 0.798 
(Figure 4.8). Thus, the stability robustness margin is equal to sm = 1/0.798 = 1.25 
so that the system can tolerate up to 125 percent of the modeled uncertainty. The robust 
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Cart position 



Time (s) 

Figure 4.9 Cart position obtained by Monte-Carlo simulation 


stability of closed-loop system with nonlinear plant model is illustrated by using the 
Monte-Carlo analysis. It is done by the program sim_MC_PID. m which obtains the 
transient responses for ten random combinations of the uncertain parameters given 
in Table 4.1. 

The results from Monte-Carlo simulation are shown in Figures 4.9 and 4.10. It 
is seen that the closed-loop system with nonlinear model is robustly stable but does 
not achieve robust performance. For some simulations, the transient response cannot 
reach steady-state value for 25 s, because of significant influence of noises on control 
action (Figure 4.11). The worst performance of the cart-pendulum closed-loop system 
is assessed by the largest possible gain in the frequency domain (“worst case” gain). 
The worst case analysis is done by the M-file PID_wcp. m which utilizes the function 
wcgain from Robust Control Toolbox. The structure wcunc containing a combi¬ 
nation of uncertain element values which maximize the system gain is substituted 
in the complementary sensitivity function. The magnitude plot of the closed-loop 
system in respect to the cart position for 30 random samples of the uncertain param¬ 
eters and for the worst case gain is shown in Figure 4.12. The obtained closed-loop 
system bandwidth of 0.42 rad/s for worst case uncertainty is comparatively small. 
The closed-loop transient responses in respect to the cart position and pendulum 
angle are given in Figures 4.13 and 4.14, respectively. It is seen that the system has 
almost the same aperiodic transient responses. The pendulum angle deviations from 
zero are sufficiently small. The M-file PID_wcp computes also the worst case gain 
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Pendulum angle 


1.4 



Time (s) 


Figure 4.10 Pendulum angle obtained by Monte-Carlo simulation 


Control action 
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Time (s) 

Figure 4.11 Control action obtained by Monte-Carlo simulation 













Controller design 217 


Magnitude plot of the uncertain closed-loop system 



Figure 4.12 Worst case closed-loop system gain 


Position step response 
From: ref To: [+DG„lin](l) 



Time (s) 


Figure 4.13 Worst case cart position 
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Angle response 
From: In(l) To: [+DG„lin](2) 



Time (s) 

Figure 4.14 Worst case pendulum angle 


margin of the closed-loop system using the open-loop transfer matrix L(s). As a result, 
one obtains 

wcmarg = 


GainMargin 

PhaseMargin 

Frequency 

WCUnc 

Sensitivity 


[0.896631324710085 1.115285594470323] 
[-6.239204284065615 6.239204284065615] 
27.085636561297559 
[lxl struct] 

[lxl struct] 


This means that the maximum allowable gain margin for all possible defined 
uncertainty ranges is up to 0.8966 and 1.1153 = ±0.947 dB and phase margin varia¬ 
tions of ±6.239 deg. This result is in agreement with the results from robust-stability 
analysis. 

In Figure 4.15, we show the magnitude plot of closed-loop sensitivity of control 
action to the reference and encoder noises. It is seen that the noise in measuring 
the pendulum angle 0 is more significant than the noise in measuring the car posi¬ 
tion p. The sensitivity of control action to noise in pendulum angle is significant 
in wide frequency range especially in high frequencies. The peak value of 7.4 dB 
means that in this frequency range, the controller will increase a noise in pendulum 
angle more than two times. Note that this peak is in the range where the noise in 
0 is significant. This is in agreement with results from Monte-Carlo simulation of 
closed loop with nonlinear model and leads to undesirable variations of control action 
(Figure 4.11). □ 
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Sensitivity of control to reference and noises 
From: In(l) To: [+pid (/ ] 



Frequency (rad/s) 


Figure 4.15 Control sensitivity to reference and noises 


4.2 LQG controller with integral action 


MATLAB files used in this section 


Files for basic LQG controller 

Description 

LQG_design 

Design of LQG controller 

LQG_robstab 

Robust-stability analysis 

dfrs_LQG 

Frequency responses 

sim_LQG 

Simulation 

sim_MC_LQG 

Monte-Carlo simulation 

Files for LQG controller with bias compensation 

Description 

LQG_bias_design 

Design of LQG controller 

LQG_bias_robstab 

Robust-stability analysis 

dfrs_LQG_bias 

Frequency responses 

sim_LQG_bias 

Simulation 

sim_MC_LQG_bias 

Monte-Carlo simulation 

LQG_bias_wcp 

Worst case gain 


In this section, we present two versions of LQG controller with Kalman filter 
state estimation and integral action. The purpose of these controllers is to ensure 
accurate tracking and regulation in presence of disturbances and noises. It is shown 
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that the basic version of such controller produce satisfactory results in case of nominal 
plant model but may have a bad performance when the plant model vary. That is why, 
a bias compensation is done in case of uncertain plant by adding additional states to 
the Kalman filter state vector. This may increase significantly the closed-loop system 
robustness, as demonstrated by examples. 


4.2.1 Discrete-time LQG controller 

The basic configuration of a closed-loop system with LQG controller comprising 
LQR and a Kalman filter is shown in Figure 4.16. The LQR is designed to minimize 
a quadratic performance index, and the Kalman filter produces optimal system state 
estimate in presence of process noise v and measurement noise w. The system error 
e is integrated in order to reject constant disturbances and/or achieving of set point 
regulation properties (zero steady-state error in case of step reference r). 

The discrete-time LQG controller design may be presented briefly as follows. 
Assume that the time-invariant system is described by the difference state and output 
equations 

x(k + 1) = Ax(k) + Bu(k) + v(k), 

y(k) = Cx(k) + w(k), ( ) 

where x(k ) is the state vector, y(k) is the measurement vector, and v(k), w(k ) are 
the process noise and measurement noise, respectively; A,B, and C are constant 
matrices with appropriate dimensions. It is assumed that v(k) and w(k) are stationary 
independent zero-mean Gaussian white noises with covariances 

E {v(£)v(/) r } = VS(j - k), E {w{k) W (jf} = WS(j - k), 

where E {.} denotes mathematical expectation, <5(-) is the unit impulse function, and 
V, W are known covariance matrices. 



Figure 4.16 LQG control with integral action 
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The discrete-time LQG problem for the system (4.12) consists of finding the 
optimal control u = u opt which minimizes the quadratic performance index 

J = E\j>2 x(k) T Qx(k) + u(k) T Ru(k ) (, (4.13) 

l o J 

where Q is a symmetric positive semidefinite matrix and R is a symmetric positive 
definite matrix. 

It is well known that according to the separation principle [44,73,111], the 
LQG problem is decomposed into two subproblems, namely, LQR design of optimal 
control law 

u(k) = -K opt x(k) (4.14) 

of the deterministic system 

x(k + 1) = Ax(k) + Bu(k), 

y(k) = Cx(k), ( ) 

and design of optimal state estimator {Kalman filter) (see Section 2.4) 

x(k + 1) = Ax(k) + Bu(k) + L(y(k + 1) - CAx(k) - CBu{k )) (4.16) 

of the stochastic system (4.12). The optimal control of the system (4.12) which 
minimizes (4.13) is then given by the state estimate feedback control law 

u{k) = -K opt x{k), (4.17) 

which stabilizes the closed-loop system. 

The gain matrices K opt and L arising in the solution of the LQG problem are 
determined by solving two matrix algebraic Riccati equations as follows. 

If the matrix pair (A, B) is stabilizable and the matrix pair (Q I/2 ,A) is detectable, 
the optimal gain matrix K opt in (4.14) is determined as 

K opt = {R + B t SB)~ 1 B t SA, 

where S is the positive semidefinite solution of the discrete-time matrix Riccati 
equation 

A t SA -S + Q- A t SB(R + B T SB)~ l B T SA = 0. 

In such case, the resulting closed-loop system is asymptotically stable (the eigenvalues 
of A — BK opt are inside the unit circle in the complex plane). Moreover, the closed-loop 
system has guaranteed gain and phase margins for all inputs. 

Provided the matrix pair (A, V ,/z ) is stabilizable and the matrix pair (C,A) is 
detectable, the optimal gain matrix L of the Kalman filter (4.16) is determined as 

L = PC T {CPC T + W)~\ 

where P is the positive semidefinite solution of the matrix Riccati equation 
APA t -P+V- APC t {CPC t + W)~ l CPA T = 0. 
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In such case, the Kalman filter is stable (the eigenvalues of (I — LC)A are inside the 
unit circle), i.e., E \x(k)\ E {x(k)) as far as k —> oo and the error covariance is 
given by 

E{{x(k)-x(k)\x(k)-x{k)) T }=P. 

Hence, the elements of the matrix P can be used to assess the error covariance of the 
state estimate x(k). 

As opposite to the case of LQR control used alone, there are no guaranteed 
stability margins of the closed-loop system involving LQ regulator and Kalman filter. 

The optimal state regulator (4.14) is computed in MATLAB using the function 
dlqr and the discrete-time Kalman filter is designed using the function kalman. 
The function kalman designs a Kalman filter of a system with the general description 

x(k+ 1) = Ax(k) + Bu(k) + Gv(k), 
y(k) = Cx(k) + Hv(k) + w(k ) 

where the process noise v(k) and the measurement noise w(k) can be correlated. An 
alternative to the functions dlqr and kalman is the function lqg which determines 
the whole LQG controller. The function lqg also has an option to include integral 
action in the controller. 

Consider now how to include integral action in the controller. It is well known that 
the conventional LQG controller can ensure zero steady-state control system error if 
the plant gain is exactly known or/and the plant operates without output disturbances. 
In practice, we always have output disturbances and we often have uncertainty in plant 
gain. That is why, it is important to implement integral action in the LQG controller. 

An approximation of the discrete-time integral of the system error e(k) may be 
computed by the difference equation 

q(k + 1) = q(k) + T s e(k) = q(k ) + Tfr(k) - y(k)\ (4.18) 


where q(k) has the dimension of y(k) and T s is the sampling interval. Combining this 
equation with the system equations (4.15), one obtains the augmented system 


x(k + 1) = Ax(k) + Bu(k) + Gr(k ) 
y(k) = Cx(k ) 


with state vector 


m = 


- X (k) 

q(k)_ 


and matrices 


a -[4c "]• Ho]- e =t c HH 


(4.20) 


It may be proved that the system (4.19) is stabilizable provided the original system 
(4.12) is stabilizable and if there is no zero of the original system on the unit circle. 
Hence, the system (4.19) can be optimized in respect to a quadratic performance 
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index considering as a state vector the vector x(k). As a result, the optimal control 
law is obtained in the form 

u(k) - -K 0 x(k) = —K x x(k) - K q q{k), 
where the optimal state feedback matrix 
K 0 = [K x K q \ 

is partitioned according to the dimensions of the vectors x(k) and q(k). In this way, 
the optimal control law is obtained as a feedback in the plant and integrator states. 

The integral action LQR controller may be designed again by the function dlqr, 
but instead of matrices A,B one has to use the matrices A, B. 


4.2.2 Colored measurement noise 

If the process and measurement noises are colored, then the original system dynamics 
has to be augmented with the dynamics of the corresponding shaping filters. As it is 
shown below, this may lead to numerical difficulties. 

Consider the case of colored measurement noise w. This noise may be represented 
as an output of the shaping filter 

4r(k+l) = A w f(k) + B w r,(k), 

w(k ) = C w x!r(k) + D w r](k), [ ) 


whose input is a white noise rj(k) with covariance 
E {r](k)ri(J) T } = IS(J - k ), 


where the covariance matrix I is an unit matrix of dimension equal to the dimension 
of q(k). Combining (4.12) and (4.21), one obtains 




Denoting 



(4.22) 


(4.23) 


_° Av_ 
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(4.22) can be written as 

~x(k+\) = A~x(k) + Bu(k) + Gm, (424) 

y(k) = Cx(k) + Hv{k), ' ; 

where 

£ i» (WW T=sj[;®][v»f j]. 

In this way, we obtain the augmented system (4.24) which has no measurement noise. 
It is not possible to design Kalman filter for such systems using the solution of 
Riccati equation since the measurement noise variance matrix W should be nonsin¬ 
gular matrix. Alternative solution, which does not rely on the augmentation of the 
state vector, is described in [44, Section 2.7.3], [78, Section 7.2.3], A simple solu¬ 
tion may be obtained as follows. Instead of estimating the state of system (4.24), the 
Kalman filter is designed to estimate the state of the system 

x(k + 1) = Ax(k) + Bu(k) + Gv(k), 

y(k) = Cx(k ) + Hv(k) + w(k), 1 ' ’ 

where the matrix W = E \w(k)w(k) T } is chosen in the form 10 -i 7 for some suf¬ 
ficiently large positive p. Obviously, this is equivalent to introducing a small 
measurement noise in the system equations. Note that the matrix W chosen in this 
way is perfectly conditioned so that its inversion will not pose a problem. The price 
for this simple solution is that the estimate produced by the Kalman filter is no more 
optimal, since the filter should fight an additional fictitious noise. Fortunately, this 
noise may be chosen sufficiently small. 

Example 4.2. Design of a LQG controller for the cart-pendulum system 

Consider the design of a LQG controller with integral action for the cart-pendulum 
system presented in Chapter 2. The block diagram of the closed-loop system com¬ 
prising the plant and the controller is shown in Figure 4.17. The plant input is the 
control signal to the cart motor actuator, and the plant outputs are cart position p and 
pendulum angle 6. The control system goal is to keep the cart position equal to the 
reference in presence of noises and disturbances stabilizing in the same time the pen¬ 
dulum in the inverted position. The variables p and 9 are measured by 12-bit encoders 
which generate measurement noises, the cart velocity p and pendulum angular veloc¬ 
ity 9 being not measured. This makes necessary to find an estimate of system state 
by using a Kalman filter in the controller. The cart position error is integrated by a 
discrete-time integrator and included as an additional system state in the LQR design. 
The state-space equations describing the fourth-order continuous-time plant are 

xft) = A c x c (t) + B c u(t), 
y c (t) = C c x c (t), 
where 


.(0 = \pOp Of, y c (t) = \p 9f. 
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Figure 4.17 LQG controller of cart-pendulum system 


The matrices A C ,B C , C c are given by 

"0 0 1 0 

0 0 0 1 

~ 0 m 2 l 2 g/den —f c I t /den —f p lm/den 

0 M,mgl/den —f c ml/den —f p M t /den 

" 0 " 

0 

= kp I t l den ’ 

_lm/den_ 


C c = 


0 0 0 ] 

1 0 0 _|’ 


where the plant parameters with their tolerances are given in Table 4.1. 

The LQG controller design for cart-pendulum system is done by the M-file 
LQG_design. 

The nominal discrete-time plant model (4.15), obtained for sampling interval 
T s = 0.01 s, has a state vector 

x(k) = [p(k) 9(k)p(k) 6(k)] T 
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and matrices (to four decimal digits) 


'1 3.2815 x 10“ 4 
0 1.0016 x 10° 

0 6.5578 x 10“ 3 
0 3.1691 x IQ” 1 


9.9695 x 10 -3 
-9.2424 x 10“ 5 
9.9390 x 10- 1 
-1.8470 x 10“ 2 


9.7135 x 10- 8 ' 
1.0005 x 10“ 2 
3.0358 x 10“ 5 
1.0015 x 10° 


"7.8521 x 10- 4 " 

2.3771 x 10“ 3 h 0 0 0] 

1.5689 x lO” 1 ’ C_ [o 1 0 oj’ 
4.7506 x lO” 1 


The augmented plant discrete-time model of fifth order used in the LQR design 
has the form (4.19) with state vector 

x(k) = [p(k)e(k)p(k)G(k)q(k)] T , 


where q(k) is the discrete-time approximation of the position error integral obtained 
by the difference (4.18). The matrices A,B,C are determined according to (4.20). 
Note that the augmented state matrix A has two eigenvalues on the unit circle. The 
weighting matrices 


Q = diag( 1,1,000,100,1,000,10,000), R = 1,000 


are chosen so as to obtain satisfactory closed-loop transient responses with control 
action less than 0.5. 

The LQR design, done for matrices A,B, Q,R, produces the optimal feedback 
matrix 


K 0 = [-2.9779,7.2230,-1.8493,1.5156,2.4131]. 


The design of the Kalman filter takes into account the quantization noises n\ and n 2 
produced by the encoders which measure the cart position and the pendulum angle, 
respectively. As shown in Chapter 2, m and n 2 may be considered as white noises 
with variances equal to 

_ 0.235 1 _ 2jv 1 

Fl = ^7!r Vl = 2^7tt 


respectively. However, in the Kalman filter design, we assume that the noises in p and 
9 are generated by first-order shaping filters with unit variance input white noises ip 
and rj 2 , respectively. The shaping filters transfer functions are chosen as 


W ni (s) 


Vi 


5s + 50 
0.015+ f 


W n2 (s) = 


0-55 + 10 

%.01s+ 1' 


In the low-frequency range, these shaping filters produce outputs which approximate 
the encoder noises n\,n 2 (Figure 4.18). In the high-frequency range, the intensities 
of the filter outputs increase to take into account other noises in the physical system 
like the actuator noise. 
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g 

I 


Sensor noise shaping filters 



Frequency (rad/s) 


Figure 4.18 Magnitude plots of noise shaping filters 


In the given case, we have that 



and from (4.24), we obtain the sixth-order system 
x(k + 1) = Ax(k) + Bu(k) + Grj(k), 

V(k ) = Cx(k) + Hri(k), 

where 



i !f(k) is a vector containing the shaping filters states and 
E {rj(k)r](k) T } = I = ^ ®J . 

According to (4.23), the system matrices are determined as 


0 0 0 0 3.6788 x IQ- 1 0 

0 0 0 0 0 3.6788 x 10“' 
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,1 -7.4530 x 
0 


0 0 

0 0 

0 0 

0 0 

6.3212 x tO -3 0 

0 6.3212 x 10 -3 


~ ("8.2811 x 

H =[ 0 


io - 3 


0 

2.2141 x 10 -2 ' 


Since there is no formal measurement noise in the system equations, the variance 
matrix W of the measurement noise is chosen as 


The Kalman filter designed is of sixth order. Its optimal gain matrix is 


4.0253 x 10“ 5 
2.1381 x 10“ 3 
2.2563 x 10 -4 
1.1985 x 10 -2 
3.6716 x 10“ 2 
-2.7569 x 10“ 4 


1.7184 x 10 -3 
9.1278 x 10 -2 
9.6325 x 10 -3 
5.1165 x IO” 1 
-9.5254 x 10“ 5 
6.0634 x 10“ 2 


The diagonal elements of the covariance matrix P are 
{4.47 x 10 -8 ,1.26 x 10 -4 ,1.40 x 10“ 6 ,3.96x 10“ 3 ,4.45 x 10“ 5 ,3.86x 10“ 5 } 

and can be used to determine error bounds on the estimate x(k). In particular, the 
estimate of 9 has the largest error bound corresponding to mean square error equal 
to 0.0629 rad/s. 

The closed-loop system with LQG controller is simulated by the Simulink file 
clp_LQG. six. The controller model is shown in Figure 4.19. The controller 
involves Kalman filter, optimal feedback matrix, and discrete-time position error 
integrator. The presence of unit sample delay element reflects the fact that in the 
estimation at the moment k, we may use the value of control action u at the moment 
k - 1. (The lack of the delay element will lead to the appearing of algebraic loop in the 
simulation diagram.) The implementation of the Kalman filter is done in state-space 
using single precision taking into account that the controller will be implemented on 
a processor having floating-point unit (Figure 4.20). 

The results from simulation of nominal closed-loop system for step references of 
magnitude 0.5 and —0.5 m are shown in Figures 4.21 and 4.22. The steady-state error 
of cart position is zero due to the using of integral action controller. It should be noted 
that although the cart position and pendulum angle measurements are discontinuous 
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Single precision LQG controller 


CD-J- 
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CtrlSatl Zero-order c 


Figure 4.19 Simulink model of the LQG controller 


Kalman filter 





Figure 4.20 Simulink model of the Kalman filter 

functions due to quantization errors, the corresponding estimates obtained by the 
Kalman filter are smooth. The control action in case of LQG regulator is shown in 
Figure 4.23). 

Consider now the robustness properties of the closed-loop system. The classical 
and disk stability margins are obtained as 


GainMargin 

GMFrequency 

PhaseMargin 

PMFrequency 

DelayMargin 

DMFrequency 

Stable 


[2.1494 9.0235e+03] 
[2.2527 87.9130] 
60.6182 

126.4363 

0.8368 











































230 Design of embedded robust control systems using MATLAB®/Simulintif 


Cart position 
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Figure 4.21 Cart position 


Pendulum angle 
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Figure 4.22 Pendulum angle 
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Control action 



Time (s) 

Figure 4.23 Control action 


GainMargin: [0.4802 2.0826] 

PhaseMargin: [-38.7026 38.7026] 

Frequency: 2.0360 

Clearly, the gain and phase margins are satisfactory. However, the robust-stability 
analysis of uncertain system, done by the M-file LQG_robstab produces the report 
report = 

Assuming nominal UFRD system is stable... 

Uncertain system is possibly not robustly stable to modeled 

-- It can tolerate up to 91% of the modeled uncertainty. 

-- A destabilizing combination of 104% of the modeled uncertainty 

— This combination causes an instability at 3.02 rad/seconds. 

— Sensitivity with respect to the uncertain elements are: 

'I' is 0%. Increasing 'I' by 25% leads to a 0% decrease 

in the margin. 

'M' is 3%. Increasing 'M' by 25% leads to a 1% decrease 

in the margin. 

'f_c' is 7%. Increasing 'f_c' by 25% leads to a 2% decrease 

in the margin. 

'f_p' is 0%. Increasing 'f_p' by 25% leads to a 0% decrease 

in the margin. 

The report shows that under the parameter tolerances given in Table 4.1 the closed- 
loop system is not robustly stable. In the given case, the peak value of the structured 
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Robust stability 



Frequency (rad/s) 

Figure 4.24 Robust stability 


Cart position 



Time (s) 


Figure 4.25 Cart position obtained by Monte-Carlo simulation 

singular value of /x, which corresponds to robust-stability analysis, is greater than 1 
(Figure 4.24). 

The poor robustness properties of the closed-loop system are illustrated by the 
Monte-Carlo analysis shown in Figure 4.25. This analysis is done by the program 
sim_MC_LQG which obtains the transient responses for ten random combinations 
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of the uncertain parameters given in Table 4.1. The large steady-state errors are due 
to the large errors of state estimates produced by the Kalman filter when the model 
varies (the Kalman filter is designed for the nominal plant model). Note that there 
exist some uncertain parameter combinations for which the closed-loop system is 
even unstable, as revealed by the robust-stability analysis. □ 


4.2.3 LQG controller with bias compensation 

The steady-state errors of uncertain closed-loop systems with LQG controllers may 
be removed by adding bias components to the state vector which are estimated 
by the Kalman filter and used to compensate the estimation errors when the plant 
model varies. This approach also improves the overall robustness of the closed-loop 
system. 

Assume that we desire to remove the steady-state error in the variable x t (k) for 
some i. We replace the z'th component of the state vector by the sum x t (k) + fl(k), 
where fi(k) accounts for the bias in x,(k). The variable fl can be modeled as random 
walk process in the form 


Kk+i )=m+g b m 


(4.26) 


for a white noise input £ (k) with is {£(£)£(/)} = 1 S(k — j) and some small constantly. 
Once we obtain an estimate x,(k) + (i(k), it may be used in the computation of 
optimal control. Therefore, the Kalman filter in the given case has to be designed 
for the system 


K+Dl-P r B -] \G 01IWI 

L P(k + i)J - L° ij [m\ + LoJ } Lo »J UwJ ’ 


'ri(k) 

m\ ’ 


(4.27) 


E \0] bufm 7 } = [J ?]*(*-/*> 


The steady-state errors of other state vector components may be removed in a 
similar way provided the corresponding augmented system is detectable. 
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Figure 4.26 LQG controller of cart—pendulum system with bias compensation 


Example 4.3. Design of LQG controller with bias compensation for the cart- 
pendulum system 

Consider how to design LQG controller with integral action for the cart-pendulum 
system removing the steady-state error of cart position. 

The LQG controller is designed by the M-file LQG_bias_design. The 
Kalman filter is designed using (4.27) for i = 1 and taking 

F= E«] [,(t)r =*• r=i °" j [J ?]• 


The constant g b is determined experimentally as 0.01. The filter obtained is of seventh 
order with optimal gain matrix 


7.4207 x 10- 1 
1.2331 x 10“ 5 
1.3012 x 10“ 6 
6.9118 x 10“ 5 
1.0891 x 10“ 2 
-1.5899 x 10- 6 
2.0272 x 10 _1 


2.2698 x 10- 5 ' 
9.1312 x 10“ 2 
9.6361 x 10“ 3 
5.1184 x lO” 1 
-3.6267 x 10 -7 
6.0630 x 10“ 2 
-8.0760 x 10 -5 
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Single precision LQG controller with bias compensation 



Figure 4.27 Simulink model of the LQG controller with bias compensation 


The block diagram of the closed-loop system for the case of bias compensation 
is shown in Figure 4.26. The corresponding Simulink controller model is displayed 
in Figure 4.27. 

The results from Monte-Carlo simulation of the closed-loop system, obtained by 
the M-file sim_MC_LQG_bias, are shown in Figures 4.28—4.30. It is seen that the 
cart position has not steady-state error. 

The frequency response plot of the structured singular value /x in case of bias 
compensation is shown in Figure 4.31. The peak value of /x is equal to 0.892 which 
guarantees that the closed-loop system achieves robust stability, i.e., for each com¬ 
bination of uncertain plant parameters the system will remain stable. The stability 
robustness margin is equal to sm — 1/0.892 = 1.12 so that the system can tolerate 
up to 112 percent of the modeled uncertainty. 

The worst performance of the cart-pendulum closed-loop system is assessed by 
the largest possible gain in the frequency domain (“worst case” gain). The worst 
case analysis is done by the M-file LQG_bias_wcp which utilizes the function 
wcgain from Robust Control Toolbox™. The structure wcunc containing a combi¬ 
nation of uncertain element values which maximize the system gain is substituted in 
the complementary sensitivity function. 
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Figure 4.28 Monte-Carlo simulation in case of bias compensation. Cart position 


Pendulum angle 



Time (s) 

Figure 4.29 Monte-Carlo simulation in case of bias compensation. 
Pendulum angle 
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Control action 



Time (s) 

Figure 4.30 Monte-Carlo simulation in case of bias compensation. Control action 



Figure 4.31 Robust stability in case of bias compensation 
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Frequency (rad/s) 


Figure 4.32 Worst case closed-loop system gain 


The magnitude plot of the closed-loop system in respect to the cart position for 
3 0 random samples of the uncertain parameters and for the worst case gain is shown in 
Figure 4.32. The peak of the magnitude response is 10.02 dB which leads to oscillatory 
transient responses. The worst case bandwidth is 1.99 rad/s. 

The closed-loop transient responses in respect to the cart position and pendulum 
angle are given in Figures 4.33 and 4.34, respectively. It is seen that the closed-loop 
system is close to instability. 

The M-file LQG_bias_wcp computes also the worst case gain margin of the 
closed-loop system using the loop transfer matrix L(s). As a result, one obtains 


wcmarg = 


GainMargin 

PhaseMargin 

Frequency 

WCUnc 

Sensitivity 


[ 0.7823 1 . 2782 ] 
[- 13.9246 13 . 9246 ] 
2.9152 
[lxl struct] 

[lxl struct] 


Hence, even in the worst case, the phase margin is about 13.9 deg which is in 
agreement with the results from robust-stability analysis. 

In Figure 4.35, we show the magnitude plot of control action closed-loop sen¬ 
sitivity to reference and encoder noises. It is seen that the noise in measuring the 
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Position step response 
From: ref To: [+DG„lin](l) 



Figure 4.33 Worst case cart position 


Angle response 
From: In(l) To: [+DG„lin](2) 



Time (s) 


Figure 4.34 Worst case pendulum angle 
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Sensitivity of control to reference and: 
From: In(l) To: [-AT.pt] 



Frequency (rad/s) 

Figure 4.35 Control sensitivity to reference and noises 


pendulum angle 0 has a stronger influence on control than the noise in measuring the 
cart position p. □ 


4.3 LQ regulator with filter 


MATLAB files used in this section 


Files for basic LQ regulator with filter 

Description 

LQR_Hln£_design 

Design of LQ regulator and M'oa filter 

LQR_Hinf_robstab 

Robust-stability analysis 

dfrs_LQR_Hinf 

Frequency responses 

sim_LQR_Hinf 

Simulation 

sim_MC_LQR_Hinf 

Monte-Carlo simulation 

Files for LQ regulator with filter 

and bias compensation 

Description 

LQR_Hinf_bias_design 

Design of LQ regulator and filter 

LQR_Hinf_bias_robstab 

Robust-stability analysis 

dfrs_LQR_Hinf_bias 

Frequency responses 

sim_LQR_Hinf_bias 

Simulation 

sim_MC_LQR_Hinf_bias 

Monte-Carlo simulation 

LQR_Hinf_bias_wcp 

Worst case gain 
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In this section, we present a LQR with integral action which uses a state estimate 
obtained by the so-called filter. Since the plant uncertainty may lead to steady- 
state errors, additional filter states are used in order to remove the estimate bias, 
similarly to the case of using Kalman filter. It is demonstrated by the example of cart- 
pendulum system that implementing such controller makes possible to obtain better 
closed-loop robustness in comparison to the case of Kalman filter implementation. 

4.3.1 Discrete-time filter 

Consider the time-invariant discrete-time system 
x(k + 1) = Ax(k) + Bu(k) + v(k), 

y(k) = Cx(k) + w(k), ( J 

where v(k) and \v(k ) are noisy terms. These noise terms may be random with possibly 
unknown statistics and nonzero mean. A distinct feature of the Mix. filter, used to 
obtain an estimate of the system (4.28), is that v(k) and w(k) may be deterministic 
disturbances. In this way, the filter does not make any assumptions about the 
statistics of the process and measurement noise, although this information can be 
used in the design of this filter if it is available. 

Further on by 

114 = 


and 

114 e = yfx T &, 


we denote the two-norm of a vector x and the (9-weigh ted norm of x, respectively, 
where Q is a positive definite matrix. 

Our goal is to find an estimate x{k) of the state vector x(k) such that 


r T.U \\x(k)-x(k)\\ 

lim 1 / -- < V, 

^°° uLo (iiv(*)n^_ 1 + 


(4.29) 


where V and W are symmetric positive definite matrices chosen by the designer and 
y is a small positive scalar, respectively. 

The inequality (4.29) can be interpreted from the game theory point of view as 
follows [78, Section 11.3]. The filter design is considered as a game between 
the nature and the designer. The nature’s ultimate goal is to maximize the estimation 
error {x{k) — x(k )) by clever choice of disturbances v(k) and w(k). The form of the 
cost function J prevents nature from using infinite magnitudes for v(k) and w(k). 
Instead, nature is assumed to actively seeks to degrade the state estimate as much as 
possible by choosing appropriate signals v(k), w(k ) maximizing the cost function J. 
Thus, the filter is a worst case filter in the sense that v(k), w(k) will be chosen 
by nature to maximize the cost function. Likewise, the designer must be clever in 
finding an estimation strategy to minimize ( x(k ) — x(k)). This makes the M J rx filter 
design a minimax problem. 
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The matrices V and W play an analogous role as the corresponding covariance 
matrices in Kalman filter design. If the process noise v(k ) and measurement noise 
w(k) are zero-mean white noises with covariance matrices V and W, respectively, then 
these matrices may be used in the design of filter. In the case of deterministic 
disturbances, the elements of V and W may be chosen according to the relative 
significance of the components of v(k) and w(k), respectively. If, for instance, the 
designer knows a priori that the second element of the disturbance v(k) is large, then 
V(2,2) should be chosen to be large relative to the other elements of V. The filter 
properties also depend on the value of the scalar parameter y. Decreasing the value 
of y increases the estimate accuracy but may lead to bad estimate response or even 
to filter instability. 

The optimal 0 filter has the form 

x(k + 1) = Ax(k) + Bu(k ) + AL(y(k) - Cx(k)), (4.30) 

where the filter gain matrix L is determined as [78] 

L = P[I — y~ l P + C T W 'CP] [ C r W 1 

and P is the positive definite solution of the discrete-time matrix algebraic Riccati 
equation 

APA t -P+V-AP [(C T W~ l C - y 1 /) -1 + p] _1 PA t = 0. 

This equation may be solved numerically by the function dare from MATLAB. The 
matrix P will be a solution to the filter problem if the following condition holds: 

P~ x -y-f + C T W~ 1 C > 0. 

This condition imposes a lower bound on y which may be found numerically by an 
iterative process. The filter found in this way is stable, i.e., the eigenvalues of 
the matrix A(I — LC ) are inside the unit circle. 

It is easy to prove that if we set y —> oo, then the filter reduces to the 
Kalman filter. That is why the Kalman filter may be considered as filter when 
the performance index J in (4.29) is set equal to oo. Hence, we come to the conclusion 
that although the Kalman filter minimizes the variance of the estimation error, it does 
not provide any guarantee as far as limiting the worst case estimation error. 

Comparing the filter with the Kalman filter, we can see that the filter 
is a robust version of the Kalman filter. In this respect, the filter theory shows 
the optimal way to robustify the Kalman filter [78], 

Consider now the case of colored measurement noise w(k). According to (4.24), 
the augmented plant equations in this case are represented as 

x(k+\) = Ax{k) + Bu{k) + Gv{k), 

y(k) = Cx(k) + Hv(k), [ > 

where the elements of matrices G and H depend on the parameters of the shaping 
filters. Equation (4.31) has the form of (4.28) with process and measurement noises 
given by 


v(k) = Gv(k), w(k ) = Ilv(k). 
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Figure 4.36 LQ regulator with filter of cart-pendulum system 


The covariance matrices of these noises are 

V = E {v(k)v(k) T } = GE \v(k)v(k) T } G t = GVG t , 

W = E {w(k)w(k) T } = HE \w(k)w(k) T \ H t = HVH t , 

respectively. If V is a positive definite matrix, but the matrices G and H are not of full 
row rank, then the matrices V, W will be positive semidefinite and cannot be inverted 
as required by (4.29). This situation arises, for example, when the dimension of v(k) 
is less than the dimension of x(k) and y(k). Provided the pair (A, G) is stabilizable 
and the pair ( C,A ) is detectable, in this case it is possible to find a stable filter 
which corresponds to a modified cost function J. 

Example 4.4. Design of LQ regulator with filter of the cart-pendulum 
system 

Consider again the cart-pendulum system whose controller design implementing 
Kalman filter was presented in Examples 4.2 and 4.3. In the given case, we shall make 
use of the LQ regulator with integral action designed in Example 4.2 but instead of 
the Kalman filter we shall implement the filter. 
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Time (s) 

Figure 4.37 Pendulum angle for y = 0.6 


The block diagram of the closed-loop system with LQ regulator and Mf filter 
is given in Figure 4.36. 

In the given case, the covariance matrix V which corresponds to the car position 
and pendulum angle encoder noises, is given by V = h, the matrix V = GVG T is 
positive semidefinite and the matrix W = HVH T is positive definite. The numerical 
experiments show that in the given case stable 0 filter exists for values of y greater 
than y mtn = 0.0270267230. 

In Figures 4.37^1.39, we show the transient responses of the pendulum angle 9 
for three Mf filters designed for y = 0.6,0.035,0.0276. Due to the discontinuous 
character of the measurements, caused by the quantization, small transient responses 
appear in the computed estimate of 9 . With the decreasing of y, the magnitude of these 
estimate oscillations increases making the estimate unacceptable for y = 0.0276. That 
is why as an appropriate value of y, we take y = 0.035. The filter gain matrix 
for this value of y is (to four digits) 


1.0296 x 10 -3 
5.4689 x 10“ 2 
5.7713 x 10 -3 
3.0655 x 10- 1 
-3.5463 x 10- 1 
9.4215 x 10 -3 


8.2516 x 10- 3 ' 
4.3830 x lO” 1 
4.6253 x 10“ 2 
2.4568 x 10° 
3.9391 x 10 -3 
-5.0120 x 10 -2 
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Pendulum angle 



Time (s) 

Figure 4.38 Pendulum angle for y = 0.035 


Pendulum angle 



Time (s) 


Figure 4.39 Pendulum angle for y = 0.0276 

































246 Design of embedded robust control systems using MATLAB®/Simulintif 

Robust stability 



The filter poles [the eigenvalues of A(/ 6 - LC)J are (to 15 digits) 

0.642285107769573 

0.270513164545753 

0.286068842806314 

0.999999996295013 

0.994286462995327 

0.945008902468039 


Note that there is a pole very close to the unit circle which is usual for the design. 

The frequency plot of the structured singular value /x corresponding to the sta¬ 
bility analysis of the uncertain closed-loop system is shown in Figure 4.40. Different 
to the case of Kalman filter implementation, the closed-loop system is robustly stable 
for the assumed plant uncertainty. The worst case stability margin is determined as 


wcmarg = 


GainMargin: 
PhaseMargin: 
Frequency: 
WCUnc: 
Sensitivity: 


[ 0.7325 1 . 3652 ] 
[- 17.5557 17 . 5557 ] 
1.8865 
[lxl struct] 

[lxl struct] 


□ 
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4.3.2 M’oq Filter with bias compensation 

Likewise the Kalman filter, the filter is designed for the nominal system model. 
In case of plant uncertainty, the estimate obtained by this filter may contain some 
bias which will lead to steady-state errors of the closed-loop system. Similarly to 
the technique used in Section 4.2, the bias may be estimated by augmenting the 
filter equations with additional states in order to obtain accurate state estimate. For 
this aim, we may use a bias equation and augmented system equations of the form 
(4.26) and (4.27), respectively. 

Example 4.5. Design of LQ regulator with filter and bias compensation 
of the cart-pendulum system 

The block diagram of LQ regulator with integral action and filter of the cart- 
pendulum system is shown in Figure 4.41. The controller is designed using the M-file 
LQR_Hinf_bias_design. As in the case of Kalman filter implementation, the 
position estimate bias fi is determined by using an additional state, which is added 
to the system state vector. The augmented state is estimated by a seventh order 
filter. This allows to remove the position steady-state error that would appear when 
the plant model varies. 

In Figures 4.42^1.44, we show the results of Monte-Carlo simulation of 
cart-pendulum closed-loop system with LQ regulator, filter, and bias com¬ 
pensation for ten combinations of the uncertain parameters computed with the M-file 



Figure 4.41 LQ regulator with filter of cart-pendulum system with bias 
compensation 
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Cart position 



Time (s) 

Figure 4.42 Monte-Carlo simulation in case of bias compensation. Cart position 



Time (s) 

Figure 4.43 Monte-Carlo simulation in case of bias compensation. Pendulum 
angle 
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Control action 
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Figure 4.44 Monte-Carlo simulation in case of bias compensation. Control action 


Robust stability 



Frequency (rad/s) 


Figure 4.45 Robust stability in case of bias compensation 

sim_MC_LQR_Hinf_bias. Obviously, the bias compensation allows to remove 
the cart position steady-state error. 

The plot of the structured singular value /i corresponding to robust-stability 
analysis of the closed-loop system is shown in Figure 4.45. The closed-loop system 
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achieves robust stability the peak value of fi being equal to 0.516. This means that 
the system can tolerate up to 194 percent of the modeled uncertainty. 

The worst case frequency responses and time responses of the closed-loop sys¬ 
tem are computed by the M-file LQR_Hinf _bias_wcp. The magnitude plot of the 
cart position closed-loop transfer function for 30 random samples of the uncertain 
parameters and for the worst case gain is shown in Figure 4.46. The peak of the mag¬ 
nitude response is 2.5 dB which is acceptable. The worst case closed-loop bandwidth 
is 1.9 rad/s. 

The worst case closed-loop transient responses of the cart position and pendulum 
angle are given in Figures 4.47 and 4.48, respectively. 

The worst case gain and phase stability margins are computed as 

wcmarg = 


GainMargin 

PhaseMargin 

Frequency 

WCUnc 

Sensitivity 


[ 0.5670 1 . 7637 ] 
[- 30.8951 30 . 8951 ] 
2.1331 
[lxl struct] 

[lxl struct] 


and are significantly larger than the corresponding margins of the system with Kalman 
filter. 

The magnitude plot of control action sensitivity to the reference and encoder 
noises is shown in Figure 4.49. This plot is similar to the control sensitivity plot in 
case of Kalman filter implementation (Figure 4.35). □ 
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Position step response 
From: ref To: [+DG„lin](l) 



Angle response 
From: In(l) To: [+DG„lin](2) 



Time (s) 


Figure 4.48 Worst case pendulum angle 
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From: In(l) To: [-K 0 p(\ 



Frequency (rad/s) 


Figure 4.49 Control sensitivity to reference and noises 


4.4 Design 


MATLAB files used in this section 


Files for design 

Description 

hinf_design 

Design of controller 

hinf_robust_analysis 

Robust-stability and robust-performance analysis 

dfrs_hinf 

Frequency responses 

sim_hinf 

Simulation 

sim_MC_hinf 

Monte-Carlo simulation 

hinf_wcp 

Worst case gain 


In this section, we consider the application of optimization to the design of 
stabilizing controllers which are capable to ensure efficient disturbance attenuation 
and noise suppression. For unity of presentation with the previous controllers, we 
give the formulas for the design of discrete-time controllers. 

4.4.1 The design problem 

To formulate the general .Adf design problem, we shall use the block diagram rep¬ 
resented in Figure 4.50. In this representation, the “exogenous input” w is an ni\ 
vector of all signals which are input to the system and the “error” z is api vector of 
all signals (errors) that are necessary to characterize the behavior of the closed-loop 
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Figure 4.50 Control problem 


system. Both vectors may contain components which are abstract in the sense that 
they can be defined mathematically but do not represent signals that really exist at 
some system point. Here u is the m 2 vector of control signals andy is the p 2 vector of 
measurable outputs. P represents the generalized plant model of order n and K is the 
controller. 

Let the state-space description of the generalized time-invariant plant model P 
is given by the linear difference equation 

x(k + 1) = Ax(k) + B\w(k) + B 2 u(k), 

z(k) = C\x(k) + D n w(k ) + D n u(k), (4.32) 

y{k) = C 2 x(k) + D 2 \ w(k) + D 22 u(k). 

The closed-loop system in Figure 4.50 is described by the following equations: 

MJ (4.33) 

u = K(z)y, 

where the transfer function matrix P(z) is partitioned as 


PC) = 


Pl{ 

Pl{ 


p>»(* 


) 

) 


PnC)] 

P2lC)\ ' 


m 2 


The plant transfer function matrix P(z) is determined from the state-space description 
(4.32) by 


n{ 

P{z)= Pii 
Pi{ 



mi 


m 2 


The transfer function P(z) is derived from the nominal plant model but may contain 
some weighting functions depending on the problem under solution. The closed-loop 
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system transfer function matrix from w to z is given by the lower linear fractional 
transformation (LFT) 

z = FfP,K)w, (4.34) 

where 

FfP,K) = P n + P n K(I - P 22 Kf'P 2t . 

The standard problem for optimal control is to find all stabilizing controllers K, 
which minimize 

PW^)lloo = max o{Fi{P,K)(e jd ), 

$e(-n,7T] 

i.e., to solve the optimization problem 

min HF^.AOIU. (4.35) 

^stabilizing 

The o norm has several important interpretations in the terms of system perfor¬ 
mance. One of them is that the minimization of norm minimizes the peak value 
of the maximum singular value of F f (P, K)(e> e ). It also has an interpretation in the 
time domain as an induced 2-norm, characterizing the worst case. Let z = F f (P, K)w. 
Then 

ll^(/ , ,^)lloc = max-^fc: (4.36) 

w f*> || W || 2 

where 

I Mb = | E z (ky z (k) 

is the 2-norm of the discrete-time vector signal z. 

In practice, usually it is not necessary to obtain the strictly optimal controller 
for the problem and it is theoretically and computationally simpler to design 
a suboptimal controller, i.e., a controller which is close to the optimal one in the 
sense of norm. Let y mm is the minimum value of F e (P,K ) over all stabilizing 
controllers K. Then, the problem for suboptimal control is for a given y > y min 
to find a stabilizing K, such that 

F t (P,K) < y. 

If we desire an optimal controller that achieves y mm to within a specified tolerance, 
then it is possible to perform a bisection on y until its value is sufficiently accurate. 
This leads to an iterative procedure which may require several steps. 

Currently, there are two types of numerical methods to solve the continuous¬ 

time or discrete-time suboptimal problem. The first type is an algorithm which is based 
on the solution of two nth order indefinite matrix algebraic Riccati equations. This 
approach has computational complexity of order n 3 per step and is the only practical 
choice for higher dimensional problems. It may be associated, however, with some 
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numerical difficulties especially when y approaches y mm ■ The second type of methods 
embeds the problem into a linear matrix inequality (LMI) and then employs 
methods for semidefinite programing to find y mm [112], The LMI methods allow to 
remove some of the numerical difficulties associated with the Riccati-based methods, 
but their computational complexity is of order n 6 , which makes them practical only 
for low-dimensional problems. 

The algorithm for suboptimal design [99, Section B.4], presented briefly 
below, is a discrete-time counterpart of the famous Glover-Doyle algorithm [113] 
used in the continuous-time ,744 optimization. The solution of the ,244 suboptimal 
control problem by this algorithm is found under the following assumptions: 

A1 (A, B 2 ) is stabilizable and (C 2 , A) is detectable; 

[ A - e je /„ B 2 1 

^ D has full column rank for all 0 e (—n, n\, 

[ A — e je I 5,1 

c D I has full row rank for all 0 £ (-it, zr]; 

A4 D 22 = 0. 


Assumption (Al) is required for the existence of stabilizing controllers K. 
Assumptions (A2) and (A3) ensure that the optimal controller does not cancel poles 
or zeros on the unit circle. Assumption (A4) is not required by the optimization, but 
it simplifies significantly the expressions used in the computation of the suboptimal 
controller. If the matrix D 22 is nonzero, then it is possible to construct an equivalent 
<244 problem, in which it is zeroed. 

To simplify the solution, it is also assumed that 


A5 The matrix D\ 2 is of full column rank, i.e., D T n D\ 2 > 0, 
A6 The matrix D 21 is of full row rank, i.e., D 2X D T 1X > 0. 


Let 



and define 


-y 2 4, 


L 0 -k 2 4 2 


Let Xoo be the solution to the discrete-time Riccati equation 



A,,, = C r JC + A r X 00 A - L T R~ l L, 


(4.37) 


where 

* = 0^5 + ^=: [£ f]- 


L = D T JC + B t X oq A =: 
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Assume that there exists an m2 x m2 matrix V\ 2 such that 
V^Vn = A, 

and an mi x mi matrix Ai such that 

V[ x V 21 = -y~ 2 V, V = R ! - R t 2 R-'R 2 < 0. 

Define the matrices 


A t B,~ 
C, D t 


~ A, | B h B t2 
C h | A„A 12 

_c t2 | A 21 A 22 _ 


Z-SiV-Ay | 


0 " 

LnA'CA-AV-'A) | 

VnRi'RiVf,' 

I 

c 2 — Ai V _1 Ly 1 

D 2 i AV 

0 _ 


I v = h — R^R^In- 

Let Zoo be the solution to the discrete-time Riccati equation 
Zoo = B,J~B T t + AtZ^Aj - M t S; ] Mj (4.38) 


M, = ~B,jb T t +A t Z 00 Cj =: \M h M h \. 

Further on we shall refer to (4.37) and (4.38) as to X-Riccati equation and Z-Riccati 
equation, respectively. 

As it is proved in [99], a stabilizing controller that satisfies 
IIA(AA>lloo < y 
exists, if and only if 

1. There exists a solution to the Riccati equation (4.37) satisfying 

Xoo > 0, 

R t -R T 2 R-'R 2 = V < 0 
such that A - BR~ l L is asymptotically stable. 

2. There exists a solution to the Riccati equation (4.38) such that 

Zoo > 0, 

S h - S l2 S-'Sf 2 < 0 

with A, — asymptotically stable. 




Controller design 257 


In this case, a controller that achieves the objective is 

x(k + 1) = A t x(k) + B 2 uik) + M t2 S-'(y(k) - C l2 x(k )) 
V n u(k) = -C h x(k ) - S, 2 S^(y(k) - C h x(k)) 

which yields 


K 0 


\A l -B 2 V n '(C l ,-S l2 S-'C l2 ) 

-M h SZ l ( 

\ ~B 2 V n 'S tl S~ ] +M l2 S-'^ 

L - v n(C h ~S l2 S-'( 

4) 

-v n 's l2 s-' \ 


This is the so-called central controller which has the same number of states as the 
generalized plant P(z). 

As it follows from (4.39), the controller has an observer structure like in 
the continuous-time case [82, Section 16.8], [87, Section 9.3], The vector w(k)* = 
V~ l Ls/x(k) can be interpreted as an estimate of the worst case disturbance (exogenous 
input w) and the product 


C t2 x(k ) = C 2 x(k) - D 2t V-'Lvx(k) = C 2 x(k ) - D 2l w(kf 


represents an estimate of the worst observer input. 

In this way, the solution of the suboptimal control problem requires solution 
of two matrix Riccati equations similarly to the solution of the LQG problem. If 
y —> oo, then the Riccati equations (4.37) and (4.38) tend to the corresponding Riccati 
equations in LQG problem. 

If one wants a controller which achieves y m \ n up to specified threshold, it is 
possible to use a bisection procedure on y (the so-called y -iterations), until obtaining 
a sufficiently accurate value. The algorithm presented gives a test for each value of 
y to determine whether it is smaller or greater than y mm . 

It may be proved that if y is increased to very high value, then the controller 
generated by the optimization algorithm converges to an LQG controller. 

The design of the (sub)optimal controller in Robust Control Toolbox is done 
by the function hinf syn which may be used in the synthesis of continuous-time 
as well as discrete-time systems. This function may determine the controller 
implementing two Riccati equations (default algorithm) or LMI. It uses a bisection 
procedure to find y mm and there is an option to display information about the current 
iteration step. 

It should be noted that in principle, the discrete-time suboptimal design 
problem may be solved by algorithms for continuous-time design converting the 
discrete-time generalized plant into equivalent continuous-time one by using the 
bilinear transformation 


This transformation maps the unit disk in the z-plane into the left half of the 
5-plane for any h > 0. (Usually, h is chosen equal to the sampling period 
of the discrete-time system). The continuous-time controller designed in this 
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way is converted back to discrete-time by using the inverse transformation (Tustin 
approximation) 

_ 2 z- 1 

hz+V 

Such indirect method for solving the discrete-time problem is not recommended 
from numerical point of view. 


4.4.2 Mixed-sensitivity M’oo control 


Mixed-sensitivity is the name of a design procedure in which the sensitivity transfer 
function S = (I + GK)~ l is shaped along with one or more other closed-loop trans¬ 
fer functions such as KS or the complementary sensitivity function T = I — S [87], 
This is an efficient method which allows to incorporate into controller design sev¬ 
eral frequency domain requirements in order to achieve desirable trade-off between 
performance and robustness. 

Consider first the tracking problem shown in Figure 4.51. The exogenous input 
is the reference r and the error signals are z\ — - W\e = W\(r —y) and z 2 = W 2 u. 
Taking into account that S is the transfer function matrix between r and — e, and KS is 
the transfer function between r and control u, we have that z x = W t Sr and z 2 = W 2 KSr. 
The stable minimum-phase transfer functions W\ and W 2 represent weighting filters 
used to shape S and KS. Shaping appropriately, the sensitivity function S allows to 
achieve small tracking error e in the low frequency range while shaping KS allows to 
limit the controller gain and bandwidth and hence the control energy. These aims can 
be achieved by choosing W\{z) as a low-pass filter and W 2 (z) as a high-pass filter. 
Note that in the general case, W\ (z) and W 2 (z) may be set as transfer function matrices 
chosen in diagonal form for convenience. The controller design is done by solving 
the optimization problem 


^min 


r w x s 

[w 2 KS 



Figure 4.51 A mixed sensitivity setting 
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If one achieves 


11 r w x s in 


llws Jb 1 ’ 

(4.40) 

then it follows by necessity that 


d(S(e j9 )) < o( W/f e je )), 

(4.41) 

d(K(e je )S(e je j) < o(W 2 -\e je )). 

(4.42) 


Thus, the transfer functions W/ ] and Wf 1 determine the shape, i.e., the magnitude at 
different frequencies, of the sensitivity functions S and KS, respectively. Changing the 
weighting functions W\ and W 2 , it is possible to obtain the desired tracking accuracy 
using in the same time control actions with small magnitudes. 

The mixed sensitivity problem can be formulated in general form as shown in 
Figure 4.52. The controller input is v = r — y and the error signal is defined as z = 
[z\ zj] r , where z\ = W\(r — y ) and z 2 = W 2 u. It is possible to show that z\ = W\Sr 
and z 2 = W 2 KSr, as required. The elements of the generalized plant P are given by 



Pit = I, P22 = ~G, 


where the matrix P is partitioned such that 


R: a 



Figure 4.52 Minimization of S /KS sensitivity in standard for 
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The closed-loop system is described by z = F f (P, K)r, where 


r 

w 2 ks 


Suppose now that it is desirable to achieve good tracking in the presence of 
unstructured multiplicative perturbations at the plant output. This means that we desire 
to make small the sensitivity S and the complementary sensitivity T in appropriate 
frequency ranges. This leads to the optimization problem 


^ min 


WiS 

w 2 t 


(4.43) 


for appropriately chosen weighting filters W\ and W 2 . The filter W\ is chosen again 
as a low-pass filter. Since the uncertainty is increasing with the frequency, the filter 
W 2 is usually chosen as a high-pass filter. 

The mixed sensitivity design problem (4.43) is represented as a standard 
optimization problem in Figure 4.53. In the given case, we determine a controller 
K(z ) which stabilizes the closed-loop system and minimizes \\F?(P, AT)!^, where 
F f (P, K ) is the closed-loop transfer function matrix from r to [z\zff given by 


F t (P,K) = 


\ w lS 1 

[WfT-S)\ 


The generalized plant P is determined 



Pn = I, P22 = ~G. 



Figure 4.53 Minimization of S jT sensitivity in standard for 
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If we achieve \\F f (P, /'0|| oo < 1, then it is fulfilled that 

d(S( e P j) < oiW-'ie' 6 )), 

a(T(e je )S(e je )) < q_{Wf\e je )). 


(4.44) 


In the more general case, it is possible to find a stabilizing controller K 
minimizing the norm of the weighted mixed sensitivity 

[ WiS "I 

W 2 KS 

|_ WfT J 

which allows to “penalize” simultaneously S, KS, and T. This design can be done by 
using the Robust Control Toolbox function mixsyn. 


4.4.3 Two degrees-of-freedom controllers 

The mixed-sensitivity approach, considered above, may be extended to the design 
of two degree-of-ffeedom controllers. One of the possible configuration with such 
controller is shown in Figure 4.54. 

The system has a reference r, output disturbance d, and two output errors z\ and 
z 2 . The system M is the ideal model, to which the closed-loop system should match. 

In the given case, the controller^ consists of a feedback controller K y for distur¬ 
bance attenuation and a prefilter K r to achieve the desired closed-loop performance 
and is represented as 

K= [K r Ky]. 

The transfer function matrices K r and K y may be obtained as follows. 



Figure 4.54 Two degrees-of-freedom controller 
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The closed-loop system may be represented in the form of the standard problem 
shown in Figure 4.50. The system is described by 


V 


' -W X M 

W\ 

WiG ' 

Z2 


0 

0 

w 2 

ei 


/ 

0 

0 

e 2 _ 


0 

I 

G 


The closed-loop transfer function matrix is given by 

[ W,(S 0 GK r - M ) W x S 0 1 

Zlv “ [ W 2 S,K r W 1 K y S 0 \ ’ 


where the input and output sensitivities are equal to 
Si = (/ - K y G)~\ S 0 = (I - GK y y\ 

respectively. Again, the goal is to obtain stabilizing controller K that minimizes the 
norm of T~ w . The four functions that should be minimized are described in 
Table 4.3. 

In the table, W\ and W 2 are frequency dependent weighting functions that are 
called weighting performance function and weighting control function, respectively. 
The function W\ is chosen as a low-pass filter to ensure closeness between the system 
dynamics and the model in desired low frequency range and the function W 2 is chosen 
as a high-pass filter to limit the control actions in the high-frequency range. 

The model M is usually set in the diagonal form 



'Mi 

0 

... 0 ' 

M = 

0 

m 2 

... 0 


_ 0 

0 

• • • M P1 


so that to achieve decoupling of the system outputs. The blocks M t , i = \,...,p 2 are 
usually set as second-order lags with desired time constants and damping. 

The design of two degree-of-freedom controller is done taking as input to the 
controller the vector v = [r T y T ] T . 


Table 4.3 .Aff function to be minimized 


Function 

Description 


Wi(S 0 GK r -M) 

WiS 0 

Weighted difference between the real and ideal closed-loop system 
Weighted output sensitivity 

W 2 SiK r 

Weighted control action due ti 

o reference 

W 2 KyS a 

Weighted control action due t 

o disturbance 
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4.4.4 Numerical issues in design 

Numerical difficulties in design may arise if some of the assumptions (A1)-(A6) 

are not satisfied. A frequent cause of troubles, especially in the mixed-sensitivity 
design, is the violation of assumptions (A2), (A3) and (A5), (A6). According to these 
assumptions we have that 

• The matrix 



n m 2 


must have rank n + m 2 (full column rank), 
• The matrix 



n m i 


must have rank n+p 2 (full row rank). 

• The p\ x m 2 matrix D u must have rank m 2 (full column rank), 

• The p 2 x ni] matrix D 2 \ must have rank p 2 (full row rank). 

It follows from the above conditions that the solution of the suboptimal 
control problem requires 


Pi > m 2 , (4.45) 

p 2 < mi, (4.46) 

i.e., the number of the error signals should be greater than the numbers of controls 
and the number of measurements should be smaller than the number of exogenous 
inputs. Note that these are only necessary (but not sufficient) conditions to satisfy 
the assumptions. If conditions (4.45) and/or (4.46) are not satisfied, it is necessary to 
increase the number p x of error signals or to increase the number m x of exogenous 
signals, respectively. 

Mf optimization problems, for which the matrix D n is of full column rank and 
the matrix D 2 \ is of full row rank, are called regular. If either of these matrices is 
rank deficient, then the corresponding problem is called singular and cannot be 
solved by using the Riccati-based approach. In such case, it is necessary to use other 
methods, for instance the LMI approach. An alternative technique, frequently used in 
practice, is to regularize the problem by perturbing slightly the matrices D 12 and/or 
Z>2i in order to increase their rank. Unfortunately, this may lead to ill-conditioning of 
some matrices used in the solution of the Riccati equations and may introduce large 
rounding errors in the result. Also, as noted in [114], such regularization technique 
may cause the value of y to drop sharply below y mm leading to controllers yielding 

poor closed-loop stability. 
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Example 4.6. Design of -Atf controller for cart-pendulum system 

Consider the design of two degree-of-freedom JA ? 00 controller with integral action for 
the cart-pendulum system. Note that LQR and LQG controllers for this system were 
already designed in Examples 4.2^1.5. 

The block diagram of the closed-loop system with performance and control 
weighting functions is shown in Figure 4.55. For clearer physical interpretation the 
design problem is formulated as a continuous-time problem but the controller is 
designed in discrete-time. Since the .AKf design framework do not in general produce 
integral control, an integral of the cart position error is added to remove the position 
steady-state error. The design aim is to determine a two degree-of-freedom .dtff con¬ 
troller so as to minimize the cart position error and pendulum angle oscillations. For 
this aim, we shall implement the mixed-sensitivity design using as feedback signals 
the cart position, the pendulum angle, and the integral of cart position error. The 
design is done by the M-file hinf_design using the nominal plant model. The 
error signal z\ is obtained by “penalizing” the cart position error, the pendulum angu¬ 
lar velocity, and the integral of cart position error using the performance weighting 
function 


Wp(s) = 


The error signal z 2 “penalizes” the control 


0 

0 

10s+ 2 
10s+ 0.01- 

action using the weighting function 


W„(s) = 


0.08s+ 0.1 

0.01s+1 



Figure 4.55 Closed-loop system with controller and performance weighting 

functions 
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The magnitude plots of the inverse performance weighting functions are shown 
in Figure 4.56, and the inverse control weighting function is displayed in Figure 4.57. 
The generalized plant P is of order 11 with ni\ = 3, m 2 — \,p\ — 4,p 2 = 4. After 
discretization of the open-loop interconnection with sampling interval T s = 0.01 s 
and implementing the function hinf syn, one obtains the message 
[a bl;c2 <321] does not have full row rank at s=0 


Inverse performance weighting functions 



Frequency (rad/s) 

Figure 4.56 Inverse performance weighting functions 



10° 10 2 10 4 10 6 
Frequency (rad/s) 

Figure 4.57 Inverse control weighting function 



















266 Design of embedded robust control systems using MA TLA Bf/Simulinlf 


In the given case, the condition p 2 < m\ is violated so that assumption (A3) is 
not satisfied. To increase the row rank of the matrix 



we will increase the number m \ of the exogenous inputs adding to the control action 
an artificial small white noise « 3 with variance equal to 10 -3 . The addition of this 
noise do not change significantly the problem but leads to rank M 2 = 15 which 
allows to obtain a solution. Now we receive the following report from hinf syn: 
Resetting value of Gamma min based on D_ll, D_12, D_21 terms 
Test bounds: 0.4994 < gamma <= 67108864.0000 

gamma hamx_eig xinf_eig hamy_eig yinf_eig nrho_xy p/f 

6.711e+07 5.0e-06 0.0e+00 5.0e-06 -3.0e-05# 0.0000 f 

Gamma max, 67108864.0000, is too small !! 

Resetting value of Gamma min based on D_ll, D_12, D_21 terms 


Test bounds: 0.4994 < gamma <= 0.5158 

gamma hamx_eig xinf_eig hamy_eig yinf_eig nrho_xy 

0.516 5.0e-06 -4.6e-08 5.0e-06 -9.5e-10 0.0112 

0.508 4.le-18# ******** 5.0e-06 -3.5e-12 ******** 


Gamma value achieved: 0.5158 

The function hinf syn determines a controller for which y min = 0.5158. How¬ 
ever, for this controller, the closed-loop system has a pole at 1.0076, i.e., this system 
is unstable. In the given case, the Jif 00 optimization problem is singular due to the rank 
deficiency of the matrix D 2i (rank D 2l = 3 < p 2 ). This causes y min to drop below the 
minimal value ensuring closed-loop stability. 

The numerical difficulties in the given case can be avoided using the option to 
implement the LMI method for finding the controller. With this option, the 
function hinf syn produces the following report: 

Minimization of gamma: 


Solver for linear objective minimization under LMI constraints 
Iterations : Best objective value so far 


51 

52 


0.974273 
0.969438 
0.969438 
f lower bound: 


0.964951 
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Result: feasible solution of required accuracy- 

best objective value: 0.969438 

guaranteed absolute accuracy: 4.49e-03 
f-radius saturation: 0.732% of R = 1.00e+08 

In this case, the closed-loop system is stable and the true minimum value of y is 
equal to 0.9694. Note that the same result is obtained if the LMI method is applied 
to the original problem, since this method does not impose the rank conditions given 
above. The controller found is of 11 th order and has the disadvantage that it is unstable, 
one of his poles being at 1.0124. 

Results from robust-stability and robust-performance analysis of the closed-loop 
system with controller, obtained by the M-file hinf_robust_analysis, 
are shown in Figures 4.58 and 4.59, respectively. The closed-loop system is robustly 
stable for the plant uncertainties but does not achieve robust performance. This is a 
result from the fact that the design does not take directly into account the plant 
uncertainty. 

Results of Monte-Carlo simulation of the closed-loop system are represented 
in Figures 4.60^4.62. It is seen that the corresponding cart position and pendulum 
angle trajectories obtained for varying plant parameters are confined in relatively 
tight areas as a result of system robustness. The pendulum angle oscillations do not 
exceed 7.5 deg. 


Robust stability 



Frequency (rad/s) 


Figure 4.58 Robust stability 
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ltr 3 l(T 2 KT 1 10° 10 1 10 2 10 3 

Frequency (rad/s) 

Figure 4.59 Robust performance 


Cart position 



Time (s) 


Figure 4.60 Monte-Carlo simulation. Cart position 
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Pendulum angle 



Time (s) 

Figure 4.61 Monte-Carlo simulation. Pendulum angle 


Control action 



Time (s) 


Figure 4.62 Monte-Carlo simulation. Control action 
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Magnitude plot of the uncertain closed-loop system 
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Figure 4.63 Worst case gain 


The closed-loop system properties for the worst case uncertainty are analyzed by 
the M-file hinf _wcp. From the worst case magnitude plot shown in Figure 4.63, we 
see that the closed-loop bandwidth is 1.40 rad/s which is less than the bandwidths in 
cases of LQG and LQR controllers. The worst case cart position and pendulum angle 
are shown in Figures 4.64 and 4.65, respectively. The stability margins in the worst 
case are 


GainMargin: [0.9194 1.0877] 
PhaseMargin: [-4.8091 4.8091] 
Frequency: 4.5597 

WCUnc: [lxl struct] 
Sensitivity: [lxl struct] 


The control sensitivity to exogenous signals (reference and noises) is shown 
in Figure 4.66. As a result of the mixed-sensitivity design, this sensitivity is 
relatively low. □ 
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Position step response 
From: ref To: [+G„lin](l) 



Time (s) 


Figure 4.64 Worst case car position 


Angle response 



Time (s) 


Figure 4.65 Worst case pendulum angle 
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Sensitivity of control to reference and noises 
From: In(l) To: [+control] 

100 
50 
0 

if -50 
| -100 
'I 

I - 150 
-200 
-250 
-300 

ur* io -2 io° io 2 

Frequency (rad/s) 

Figure 4.66 Control sensitivity to reference and noises 



4.5 ii Synthesis 


MATLAB files used in this section 


Files for /x synthesis 

Description 

unc_approx_model 

Uncertain model approximation 

olp_mu_reg 

Open-loop interconnection 

mu_design 

Controller /x synthesis 

mu_robus t_analysis 

Robust-stability and robust-performance analysis 

mu_reg_comparison 

Comparison of different order /x controllers 

dfrs_mu 

Frequency responses 

sim_mu 

Simulation 

sim_MC_mu 

Monte-Carlo simulation 

mu_wcp 

Worst case gain 


In this section, we consider the /x synthesis of stabilizing controllers of multivari¬ 
able plants. It is shown that this synthesis may be associated with serious problems 
related to the presence of large number of multiple parametric uncertainties. These 
problems may be removed by some simplification of uncertainty model which allow 
to obtain an acceptable solution. It is demonstrated on the example of cart-pendulum 
system that the closed-loop system with /x controller may achieve both robust stability 
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and robust performance contrary to the other controller types, used in the previous 
sections of this chapter. 

4.5.1 The n, synthesis problem 

To apply the theory of structured singular value p to the control system design, 
the control problem is represented in the form of LFT shown in Figure 3.27 and 
repeated for convenience in Figure 4.67. The system denoted by P is the open-loop 
interconnection which contains all known elements including the nominal plant model 
as well as the uncertainty weighting functions. The block A is the uncertain element 
of the set A, which parameterizes the whole model uncertainty. The controller is 
denoted by K. The input of P are three signal sets: inputs u A from uncertainty, the 
reference, disturbance and noise signals collected in the n w -vector w, and control 
actions u. Three output sets are generated: outputs y A to uncertainty, n~ -vector of 
controlled outputs (errors) z, and measurements vector y (Figure 4.68). 



Figure 4.67 Standard representation of uncertain closed-loop system 


F,APA) 



Figure 4.68 Two different transformations of the closed-loop system 
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Figure 4.69 a Synthesis 


The set of systems, which have to be controlled, is described by the LFT (for 
definiteness, we assume the discrete-time case) 

j F V {P, A): A e A, max ff[A(e*)] < 1 1 . 

[ 0e(-jr,jr] J 

The design aim is to determine a controller K, stabilizing the nominal system, 
such that for all A e A, max#^-*,*] <r[A(e /fl )] < 1, the closed-loop system is stable 
and satisfies 

IIF^p.^aiiu < i. 

For a given arbitrary K, this performance criterion can be checked by using robust- 
performance test on the lower LFT F L (P,K). The robust-performance test should be 
done in respect to the augmented uncertain structure 

H[o A J :AeA ’ A ^ ec,,w>< " z }' 

The system with controller K achieves robust performance if and only if 
lxs P (F L (P,K)(e iS )) < 1, 

where Ap is the set of all block-diagonal matrices A P . 

The aim of the fi synthesis is to minimize the peak value H\ p (-) of the closed- 
loop transfer function matrix F L (P, K ) over the set of all stabilizing controllers K. 
This may be written as 

min max H Ap (F L (P, K)(e' e )). (4.47) 

K 

stabilizing 

The optimization problem (4.47) is shown in Figure 4.69. 

4.5.2 Replacing p with its upper bound 

One possible solution of the /x synthesis problem may be obtained replacing /x Ap (-) 
with its upper bound. For a constant transfer function matrix M = F L (P,K)(e je ) and 
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Figure 4.70 Introducing scaling matrices 


uncertain structure A P , an upper bound on iia p (M) is the optimally scaled maximum 
singular value 

Ma p (M) < inf o(DMD~ l ). 

In this inequality, D is the set of matrices with property DA P = A P D for each D g 
D, A P e Ap. Note that if the matrix A P has a full m t x m t complex block A,-, then 
the corresponding block of the matrix D is a diagonal block of the form dJ„ H . If, 
however, A P has a scalar block Sjl mj , then the corresponding block of D is a full 
mj x m 7 block D ; . 

The usage of an upper bound on the structured singular value is equivalent to the 
introduction of scaling matrices D and D~ l in the system loop as shown in Figure 4.70. 
The introduction of these matrices gives additional freedom which may be used in 
controller design. 

Using this upper bound, the optimization problem in (4.47) is reformulated as 
min max min o[D w F L (P,K)(e je )D~ 1 ]. (4.48) 

K 9s{-7t,w] Da,eD 

stabilizing 

In this equation, the minimization over D represents determination of approximation 
to the structured singular value n[F r (P, K)(e j6 )]. The scaling matrix D,„ is chosen 
from the set of scaling matrices D, independently for each w. Therefore, we have that 

min min max o[D w F L (P,K)(e je )D~ 1 ]. (4.49) 

K DueDOet-n,*] 1 V ' V 7 a J V ’ 

stabilizing 


Using the notion for M’oo norm, (4.49) is written 


min 

K 


min ||A 0 F t (P,A:)D- I || 


(4.50) 


stabilizing 
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Figure 4.71 Replacing p with its upper bound 


Consider a single matrix D e D and a complex matrix M. Assume that U is 
a complex matrix with the same structure as D, which satisfies U*U = UU* = I. 
Each block of U is unitary (orthogonal in the real case) matrix. The multiplication by 
orthogonal matrix does not affect the maximum singular value so that 

a[(UD)M(UD)-'] = d[(UD)MD-'U*] = o(DMD~ x ). 

In this way, the replacement of D by UD does not change the upper bound of p. Using 
this freedom in the phase of each block D, we restrict the frequency dependent scaling 
matrix D m from (4.50) to be a real rational, stable, minimum phase transfer function 
D(z) without affecting the value of the minimum. Note that the computation of the 
upper bound on p represents a convex optimization problem which can be efficiently 
solved. 

The new optimization problem becomes 

min min \\bF L (P,K)b- 1 II . (4.51) 

K D(z)eD 11 

stabilizing stable, 

minimum phase 

This optimization problem is solved by an iterative approach which is called DK 
iteration. A block diagram, illustrating this optimization problem, is given in 
Figure 4.71. 

4.5.3 DK iteration 

4.5.3.1 First step of DK iteration: holding D fixed 

The optimization problem (4.51) is difficult to solve since it has two independent 
matrix arguments K and D. To find an approximate solution to this problem, first 
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Figure 4.72 Absorbing the rational scaling matrices D 


consider D(z ) as a fixed stable, minimum-phase real rational transfer function matrix 
D(z). This makes possible to solve the optimization problem 


min 

K 


|DF t (p,K)ir 1 || . 


stabilizing 


(4.52) 


Define Pd to be the system, shown in Figure 4.72. The optimization problem 
(4.52) is equivalent to 

min |F t (P D ,*0|| oo . 

K 

stabilizing 


Since Pd is known at this step, this optimization problem is precisely an 
optimization problem. 


4.5.3.2 Second step of DK iteration: holding K fixed 

With K held fixed, the optimization over D is done by the following two-step 
procedure: 

1. Finding of optimal, frequently dependent scaling matrix D at a large, but finite 
set of frequencies (this is the computation of upper bound on ji). 

2. Approximating of this optimal frequency-dependent scaling matrix by stable, 
minimum-phase, real, rational transfer function D. 

This two-step procedure is considered as a sufficiently reliable approach for 
finding D. The individual steps of this procedure are carried out efficiently with the 
existing approximation algorithms based on fast Fourier transform and least squares 
method. 

The DK iterations are an efficient algorithm for n synthesis which usually works 
successfully. The most serious limitation of these iterations is that they may converge 
to a local minimum, which is not necessarily the global one. This is because the 
ji synthesis is not a convex optimization problem and it is not guaranteed that the 
iterations will find the minimum n • Despite these shortcomings, the DK iteration 
is the only available at the moment design method which allows to achieve robust 
performance of closed-loop systems with real and complex plant uncertainties. 
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The /! synthesis by DK iteration is implemented in Robust Control Toolbox by 
the function dksyn which can be used for continuous-time as well as discrete-time 
systems. 


4.5.4 Numerical issues in pt synthesis 

The DK iterations for p synthesis works well when the number of uncertain blocks is 
sufficiently small. Unfortunately, the number of multiple real uncertainties in case of 
structured uncertainty is usually large, even for low-order systems with small number 
of parameters. This may require so large number of approximations that the corre¬ 
sponding computational problem becomes untraceable. In such case, it may become 
unavoidable to approximate some or all of the real uncertainties with a single addi¬ 
tive or multiplicative complex uncertainty. Obviously, such approximation introduces 
some conservatism in the p, synthesis, but in most cases, it allows to obtain acceptable 
solution provided the performance weighting functions are carefully chosen. Another 
difficulty is related to the bad convergence of the DK iterations when the correspond¬ 
ing design problem is singular or ill-conditioned. These issues are illustrated by 

the p synthesis of the cart-pendulum system whose .Adf design was presented in the 
previous section. 

Example 4.7. p Synthesis of the cart-pendulum system 

Consider the u synthesis of a two degree-of-freedom controller with integral action 
of the cart-pendulum system using mixed-sensitivity design. 

The block diagram of the closed-loop system with the performance and control 
weighting functions is shown in Figure 4.73. This diagram is the same as the diagram 
used in ,'Adf design except that instead of the nominal plant model G„ om we shall 



Figure 4.73 Closed-loop system with p controller and weighting functions 
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make use of the uncertain model G unc . In the design, we shall use the continuous-time 
weighting functions 


W p (s) = 


0.95 


45+1 
85 + 0.05 
0 


0 

1.6 5 * +1 

105 + 0.01 

0 


0 

0 

45+1 
105 + 0.05. 


WJs) = 


0.085 + 0.1 
0.015+1 


which are similar to the corresponding weighting functions used in the design. 

In the n synthesis, we use the plant model of the cart-pendulum system which 
contains as uncertain parameters the equivalent cart mass M with multiplicity 10, the 
pendulum inertial moment / with multiplicity 10 , the dynamic cart friction coefficient 
f. with multiplicity 2, and the rotational friction coefficient f p with multiplicity 2. This 
leads to an uncertainty matrix A P with 24 real blocks and 1 complex block A F . Hence 
at the second step of the DK iteration, it will be necessary to find approximations 
of the elements of two 10x10 repeated scalar blocks and two 2 x 2 of the scaling 
matrix D which requires to perform 208 approximations at each iteration. Since each 
approximation involves computations at several frequencies, the volume of the work 
makes the problem intractable. For the example under consideration, the program 
dksyn stops to work during the approximation of the first 10 x 10 block due to 
numerical difficulties. The attempts to approximate the individual blocks containing 
the uncertainties of M and I do not lead to result. That is why all scalar uncertainties 
of M, I, and f c are approximated simultaneously by a single input multiplicative 
uncertainty. (Due to the small value of the parameter f p it is substituted by its nominal 
value.) 

The upper bound on the relative uncertainty of M,I, and f c is shown in Figure 4.74. 
The uncertainties are computed by the M-file unc_approx_model for 4 values of 
each parameter which accounts for 4 3 = 64 uncertainty values together. The upper 
bound on the relative uncertainty is approximated with sufficient accuracy by the 
magnitude response of a fourth order transfer function W m which allows to obtain 
a plant uncertainty model in the form G unc = G nom (\ + W m S) where <5 is a scalar 
complex parameter with |5| < 1. In this way, the scalar repeated uncertainties of the 
plant model are replaced by a single complex input multiplicative uncertainty. 

The Bode plots of the approximated transfer functions from control u to cart 
position p and from u to the pendulum angle 9 are shown in Figures 4.75 and 4.76, 
respectively. It is seen that the plots corresponding to the approximated complex uncer¬ 
tainty are confined to slightly wider areas in comparison to the plots corresponding to 
the exact parametric uncertainty which reflects the approximation conservativeness. 

The approximation of parametric uncertainties by an unstructured (complex) 
uncertainty may be done also for plants with several inputs and outputs. If the number 
of plant inputs n u is larger than the number of plant outputs n y , then it is advantageous 
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Upper bound of the uncertainty in 



Frequency (rad/s) 

Figure 4.74 Upper bound on the real parametric uncertainties 
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Figure 4.75 Bode plot of the transfer function from utop 
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Frequency response from u to 6 
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Figure 4.76 Bode plot of the transfer function from u to 0 


to use as an approximation output multiplicative uncertainty; while in the case when 
n u is smaller than n v , it is better to use input multiplicative uncertainty. 

The p, synthesis of the cart-pendulum system with the approximated uncertain 
plant is done by the M-files olp_mu_reg and mu_design. The first of these files 
determines the 11th order open-loop interconnection necessary for the design, while 
the second one implements the DK iterations using the function dksyn. To facilitate 
the iterations start, the first iteration is performed with a controller designed by 
the function hinf syn using the LMI option. The iteration progress is shown in the 
following report from dksyn: 

Iteration Summary 


Iteration # 23 
Controller Order 25 25 
Total D-Scale Order 10 10 
Gamma Achieved 0.935 0.895 
Peak mu-Value 0.933 0.894 


21 


0.871 


6 

0.934 

0.920 


25 

10 


1.073 


Since the peak value of p is minimal at the fourth step, it is justified to take 
the controller determined at this step. The stability test, however, reveals that the 
nominal closed-loop system with this controller is unstable. This surprising result 
is due to the fact that the matrix D 2 \ of the state-space realization of the open-loop 
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Figure 4 .77 Robust stability for ji controllers of 25th, 10th, and 5th order 


interconnection P is not of full row rank which violates assumption A(6) in the 
design step. The floating point errors introduced in the computations make this matrix 
to appear as a matrix of full rank but it is ill-conditioned which causes the computed 
upper bound on \x to drop below the minimum possible value thus leading to non¬ 
stabilizing controller. That is why in the given case, we take the controller computed 
at the third step corresponding to minimum value of /1 equal to 0.894. This controller 
stabilizes the closed-loop system and ensures robust stability and robust performance 
of the uncertain system. Note that while the open-loop interconnection is of 11th 
order, the controller designed is of 25 ft order. For this reason the controller order n c 
is reduced obtaining controllers of tenth and fifth order, respectively. 

In Figures 4.77 and 4.78, we give the plots of the structured singular values in 
case of robust-stability and robust-performance analysis, respectively, for the three 
controllers ( n c = 25,10,5). Note that the robustness analysis is done for the original 
uncertain model with real parametric uncertainty. Obviously, the controller of fifth 
order is not a suitable choice since it does not ensure robust performance of the 
closed-loop system. Further on, we shall use the controller of tenth order which leads 
to a closed-loop system with properties closed to the properties of the system with 
25th-order controller. For the tenth-order controller, fi has value of 0.332 in case of 
stability robustness analysis and value of 0.963 in case of performance robustness 
analysis. 

Results from Monte-Carlo analysis of the closed-loop system with ji controller 
are presented in Figures 4.79 and 4.80. The cart position and pendulum angle plots 
are confined to very narrow areas which is a consequence of the closed-loop system 
robust performance. 
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Figure 4.78 Robust performance for p, controllers of 25th, 1 Oth, and 5th order 
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Figure 4.79 Monte-Carlo simulation. Cart position 
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Pendulum angle 



Time (s) 

Figure 4.80 Monte-Carlo simulation. Pendulum angle 


Magnitude plot of the uncertain closed-loop system 
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Figure 4.81 Worst case gain 


















Controller desigt 


285 


Position step response 
From: ref To: [+G„lin](l) 



Time (s) 

Figure 4.82 Worst case car position 


The magnitude response of the closed-loop system for the worst case uncertainty 
is shown in Figure 4.81. The closed-loop bandwidth is equal to 1.40 rad/s, the same 
as in the case of controller. 

The worst case cart position step response and worst case pendulum angle 
responses along with the corresponding responses for 30 random values of the uncer¬ 
tain parameters are, respectively, shown in Figures 4.82 and 4.83. The worst case 
stability margins are 




GainMargin: 
PhaseMargin: 
Frequency: 
WCUnc: 
Sensitivity: 


[ 0.6668 1 . 4997 ] 
[- 22.6104 22 . 6104 ] 

[lxl struct] 

[lxl struct] 


Finally, in Figure 4.84, we show the control sensitivity to the cart position refer¬ 
ence and measurement noises. It is seen from this figure that effect of noises at the 
plant input is sufficiently small. □ 
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Figure 4.83 Worst case pendulum angle 
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Figure 4.84 Control sensitivity to reference and noises 
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4.6 Controller comparison 

A comparison of some closed-loop characteristics for different controllers in the case 
of cart-pendulum system is done in Table 4.4. (Note that the LQG controller and 
LQR controller plus filter are taken in versions with bias compensation). The 
stability robustness margin shown in the third column of the table is computed by 
using //-analysis. 

An acceptable robustness in case of PID controller is obtained at the price of 
smallest closed-loop bandwidth leading to slowest transient response. In contrast 
to the PID controller, the LQG controller (LQ regulator+Kalman filter) leads to 
fastest transient response as a result of the largest bandwidth. The worst case margins, 
however, are relatively small for this controller. The LQ regulator plus filter 
demonstrates better robustness properties than the LQG controller with comparable 
closed-loop performance for the plant under consideration. The worst case gain and 
phase margins for this controller are the largest margins for the five controllers under 
comparison. Surprisingly, the controller has worse robustness properties in com¬ 
parison to LQ regulator plus filter and a smaller bandwidth. This leads to the 

conclusion that the controller combining LQR and state estimation filter may be 
used as a successful alternative of the 3%^ controller. As expected, the best robustness 
properties of the closed-loop system are achieved by using // controller. One should 
bear in mind, however, that such properties may be obtained at the price of large 
volume of computations necessary to find the appropriate weighting functions used 
in the ji synthesis. Note that both and // controllers have smaller bandwidths 
in comparison to linear quadratic controllers which reflects the trade-off between 
performance and robustness in controller design. 


Table 4.4 Controller comparison for cart-pendulum system 


Controller 

Order 

Stability 

robustness 

margin 

Worst case 
gain margin 

Worst case 
phase margin 
(deg) 

Worst case 
bandwidth 
(rad/s) 

PID 

3 

1.25 

1.12 

±6.24 

0.42 

LQG 

7 

1.12 

1.28 

±13.9 

1.99 

LQR + 

.i/Tf filter 

7 

1.94 

1.76 

±30.9 

1.90 


11 

1.62 

1.09 

±4.8 

1.40 


10 

3.01 

1.50 

±22.6 

1.40 
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4.7 Hl l. simulation 


MATLAB files used in this section 


Files for PID controller 

Description 

sim_HIL_SCI_PID.m 

HIL_SCI_simu1ation_PID.six 

HIL_SCI_target_PID.six 

M-file for HIL simulation 
of PID controller 

Host Simulink file for HIL 
simulation of PID controller 
Target Simulink file for HIL 
simulation of PID controller 


Files for LQG controller 

Description 

sim_HIL_SCI_LQG.m 

HIL_SCI_simulation_LQG.six 

HIL_SCI_target_LQG.six 

M-file for HIL simulation 
of LQG controller 

Host Simulink file for HIL 
simulation of LQG controller 
Target Simulink file for HIL 
simulation of LQG controller 


Files for LQ regulator and -Af filter Description 


sim_HlL_SCl_LQR_Hinf.m M-file for HIL simulation of 

LQ regulator and filter 
HIL_SCI_simulation_LQR_Hinf. six Host Simulink file for HIL 
simulation of LQ regulator 
and Ji?c,o filter 

HIL_SCI_target_LQR_Hinf . six Target Simulink file for HIL 

simulation of LQ regulator 
and Jifoo filter 


Files for controller 

Description 

sim_HIL_SCI_Hinf.m 

HIL_SCI_simulation_Hinf.six 

HIL_SCI_target_Hinf.six 

M-file for HIL simulation 
of controller 

Host Simulink file for HIL 
simulation of controller 

Target Simulink file for 

HIL simulation of dfid, 
controller 
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Files for /x controller Description 

sim_HIL_SCI_mu. m M-file for HIL simulation 

of /x controller 

HlL_SCl_simulation_mu. six Host Simulink file for HIL 
simulation of /x controller 

HIL_SCI_target_mu. six Target Simulink file for HIL 

simulation of /x controller 


The generalized block diagram of the closed-loop system HIL simulation is pre¬ 
sented in Figure 4.85. The plant, actuator, and sensor dynamics with disturbances 
and noises is modeled in double precision on the host personal computer (PC). The 
corresponding controller is embedded in the target processor in single precision. 



Figure 4.85 HIL simulation of the closed-loop system 
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Figure 4.86 Host HIL Simulink model for cart-pendulum control 
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Figure 4.87 Target HIL Simulink model for cart—pendulum control 


Consider the HIL simulation of the closed-loop cart-pendulum control system. 
The host Simulink model (Figure 4.86) contains two instances of the closed-loop 
system. At the bottom of the figure nominal plant model is controlled with host imple¬ 
mented single precision controller. Above is the worst case plant model controlled 
with target implemented controller with TMS320F28335 Digital Signal Controller . 
In the given case, only plant model is host implemented, while its input and output 
signals are communicated over asynchronous serial connection with the target. So the 
target is represented as virtual or physical COM port accessible from Simulink model 
through driver blocks serial configuration, data sent and data receive. 

While plant’s model is implemented with double precision arithmetic its con¬ 
troller works with single precision or even fixed point arithmetic. A corresponding 
data type conversion blocks are the interface between different number representation 
formats. The user can select several rounding options and to observe its arithmetic 
effects. A zero-order hold block discretizes continuous-time plant output before 
sending it to the hardware target which works inherently in discrete time. 

The controller implementation in a target hardware platform receives data for the 
plant output, calculates next control action and sends it back to the host (Figure 4.87). 
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Figure 4.88 Data Flow model for code generation. Tenth-order p controller for 
inverted pendulum and cart 


The TMS320F28335 microcontroller has a dedicated SCI module for asynchronous 
communication which is accessed from Simulink model with corresponding driver 
blocks. Host and target configurations for data rate, message length, stop bit, parity 
have to match for successful communication. Data rate for example is 115,200 bps. 
Therefore, 

115,200 bps = 14,400 bps = 3,600 singles per second 

= 36 singles per tick (4.53) 

where T s = 0.01 s. With this data rate one can transmit around 30 single preci¬ 
sion numbers in each direction before sample interval to elapse. However, this is 
a theoretical maximum and practically achievable rate is around 15 signal values per 
second. 

The control algorithms for inverted pendulum are represented in single preci¬ 
sion as corresponding Simulink blocks. The model from Figure 4.88 represents the 
/r-controller with Simulink blocks appropriate for target code generation. Matrix 
gain, Unit delay and Sum blocks support control signal calculation. Saturation and 
zero-order hold blocks put amplitude and sample time constraints on the signal. 
Analogous to host implementation preprocessing applies to received data from 
serial port. 

Further on, we represent the experimental data from HIL simulation of the cart- 
pendulum system for five different controllers—PID, LQG, LQR with state 
estimator, and p -regulator. The LQG and LQR with , filter controllers are 
implemented with bias compensation. Consider for definiteness the HIL simulation 
of the cart-pendulum system in the case of LQG controller. The HIL experiment work 
flow in this case is the following one: 

• Compile the target model HIL_SCI_target_LQG. six to build executable 
.out file for deployment in embedded system. Intermediate ,c and .h files are 
generated too, representing Simulink model functionality. All files are located 
in a separate folder named HIL_SCI_target_LQG_ticcs. The subfolder 
CustomMW contains the executable file HIL_SCI_target_LQG. out. 
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• Start the Code Composer Studio (CCS) Integrated Development Environment 
(IDE). Establish a connection between CCS and the target processor (first connect 
the platform to the USB port of the host PC and then logically access target 
processor memory from the CSS). Instruct the target processor to begin execution 
of the loaded program. 

• Run the file sim_HIL_SCI_LQG. m which executes the host Simulink program 
HIL_SCI_simu1ation_LQG.six. 

The work flows for HIL simulation of the other controllers are similar to the 
described one. 

As stated previously, the aim of control design for cart-pendulum system is 
pendulum stabilization in an upward position and minimization of tracking error 
between desired and measured cart position. On a signal level, the cart-pendulum 
system acts as a low frequency filter between control u and outputs cart position p 
and pendulum angle 9. So any sinusoidal oscillation in the closed loop will be more 
strongly evident in the signal u than in the signals 9 and p. Also the dynamics of 9 is 
faster than this of p because of lower inertial properties and unstable pole related to 
9. Therefore, experimental results support that sensitivity of u to model perturbations 
is greater than sensitivity of 9 which in turn is greater than sensitivity of p. 

Consider first the results from simulation of PID controller. As noted in the 
previous section, the PID regulator is characterized by the slowest transient response. 
It is seen from Figure 4.89 that the settling time of the cart position is more than 
10 s. This regulator has relatively good robustness properties. The deviation of the 
pendulum from vertical position is small and does not exceed 1.2 deg. 

The LQG controller causes most oscillatory response for the perturbed system 
which is evident in cart position and pendulum angle measurement (Figure 4.90). 
At the same time, system reaction for the nominal parameters is not oscillatory at 
all. LQG control strategy assumes only zero mean Gaussian disturbances acting upon 
system ports and the underlying optimization problem doesn’t account for deter¬ 
ministic disturbances which would be an equivalent signal representation of applied 
parametric perturbation. 

The introduction of state observer to LQR regulator lead to considerable 
attenuation of parametric perturbation (Figure 4.91). The state feedback matrix is 
derived from similar optimization problem as is the case with LQG; however, the 
observer works to minimize maximal state estimation error rather than standard 
deviation of estimation error as in the case of Kalman filter and LQG control. As one 
can expect a more accurate state estimate can compensate to a certain level deviations 
between nominal and perturbed dynamics. 

Design of M’oa and /x controllers use different optimization cost functions con¬ 
trasting to one used in linear quadratic control. The underlying structure of these 
controllers is again a state feedback with linear observer however tuned by different 
criteria. controller minimizes the norm for the transfer matrix from exter¬ 
nal disturbances to error signals describing deviation from nominal performance. 
Since parametric perturbation of the nominal plant can be represented as equivalent 
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Figure 4.89 HIL-simulation ofPID controller for cart—pendulum system 


external disturbance, then the controller will be effective to attenuate output error 
(Figure 4.92). 

Since // controller accounts directly for the uncertainty presented in the linear 
model of cart-pendulum system closed-loop responses are least oscillatory compared 
to other designed controllers (Figure 4.93). The controller minimize the structural 
singular value /x which describes the maximal parameter perturbation that makes the 
closed-loop system unstable. 
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Figure 4.90 HIL-simulation of LQG controller for cart-pendulum system 


4.8 Notes and references 

Controller design is a fruitful area of control theory which is extremely rich of ideas 
and results. In this chapter, we present only a few results concerning the design of 
practically implemented controllers. 

The PID controller is probably the most popular control device. A readable intro¬ 
duction to the theory of PID control is given in Astrom and Murray [89, Ch. 10]. 
Detailed presentation of PID controller design and its practical implementation may 
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Figure 4.91 HIL-simulation ofLQR controller with observer for 

cart—pendulum system 


be found in many books, see for instance, Astrom and Hagglund [115], Johnson 
and Moradi [116], Visioli [117], An immense collection of PI and PID tuning rules 
is presented by O’Dwyer [118] and an overview of the functionalities and timing 
methods for PID controllers in patents, software packages and commercial hardware 
modules may be found in Ang, Chong, and Li [119]. Both decentralized and central¬ 
ized forms of PID control for multivariable processes are described in Wang, Ye, Cai, 
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Figure 4.92 HIL-simulation of controller for cart—pendulum system 


and Hang [120]. The implementation of PID controllers by using FPGA is addressed 
in [ 121 ]. Finally, the perspectives of PID control in the third millennium are discussed 
in the book edited by Vilanova and Visioli [122], 

As noted in [45, Section 5.5], the solution of LQR problem is probably one of 
the most important results in modem control theory and one that has far-reaching 
consequences for the design of optimal control systems. The LQR control theory 
begun with the seminal paper of Kalman [123] and its detailed presentation may 
be found in many excellent books such as Anderson and Moore [111], Bryson and 
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Figure 4.93 HIL-simulation of [i controller for cart—pendulum system 


Ho [71], Kwakernaak and Sivan [124], Goodwin, Graebe, and Salgado [43], Green 
and Lamebeer [99] and Hendricks, Jannerup, and Sorensen [45]. 

The LQG theory for stochastic systems is based on linear quadratic optimization 
and Kalman filtering and is presented in lots of books, among them Anderson and 
Moore [75]; Astrom [70]; Crassidis and Junkins [76]; Gibbs [77]; Lewis, Xie, and 
Popa [44]; Simon [78]; and Speyer and Chung [73], 

Inclusion of Kalman filter in the LQG controller may lead to significant shrinking 
of the closed-loop stability margin in comparison to the full state LQR. In such 
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case it is possible to use the so-called loop transfer recovery (LTR) procedure (see 
for instance [125,126]) which allows to “recover” to some extent the LQR stability 
margin. The practical implementation of this procedure is restricted to systems with 
transmission zeros in the left half part of the complex plane (minimum-phase systems) 
and square transfer functions. 

Systematic presentation of filtering theory is done in Green and Limebeer 
[99]; Lewis, Xie, and Popa [44]; and Simon [78], 

Detailed exposition of the design and /i synthesis may be found in the 
books of Zhou, Doyle, and Glover [82,102]; Green and Limebeer [99]; Skogestad 
and Postlethwaite [87]; and Sanchez-Pena and Sznaier [103]. A loop shaping 
design procedure using synthesis is presented in [127], The theory and numer¬ 
ical algorithms behind the LMI approach to the design are presented in 
Boyd, El Ghaoui, Feron, and Balakrishnan [128]; El Ghaoui and Niculescu [129]; 
Nesterov and Nemirovskii [130]; Gahinet, Nemirovski, Laub, and Chilali [112]; and 
Gahinet and Apkarian [114], The numerical problems in design are addressed in 

Gahinet [131], Gahinet and Laub [132], and Stoorvogel [133]. 



Chapter 5 

Case study 1: embedded control of tank 
physical model 


MATLAB® files used in this section 


File 

Description 

ident_tank.m 

Tank plant identification 

experiment_ident_tank.mat 

Measured input-output data for 
tank identification 

tank_static_characteristic.six 

Code generation for measurement 
of static characteristic 

tank_LQR_LQG_design.m 

Design of water level LQG 
controller 

t ank_Hinf_design.m 

Design of water level 
controller 

frs_and_time_response_LQG.m 

Plots of frequency response and 
time response of closed-loop 
system with LQG controller 

frs_and_time_response_Hinf.m 

Plots of frequency response and 
time response of closed-loop 
system with controller 

LQR_sim.six 

Simulation of closed-loop system 
with LQR controller 

LQG_sim.six 

Simulation of closed-loop system 
with LQG controller 

Hinf_sim.six 

Simulation of closed-loop system 
with M’aa controller 

Kalman_Hinf.six 

Off-line filtration of output signal 
of closed-loop system with 
controller 

LQG_cl_data.mat 

Measured data from experiment 
with LQG controller 

Hinf_cl_data .mat; 

Measured data from experiment 
with M’aa controller 


This chapter presents development and experimental evaluation of low-cost 
embedded system for control of liquid level in a model of tank. The plant is a phys¬ 
ical laboratory model of water tank produced by Lucas Niille Company [134], The 
liquid level is controlled in wide range by designed and controllers. The control 
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algorithms are implemented in low-cost control kit Arduino Mega 2560 [135]. Soft¬ 
ware in MATLAB/Simulink® environment is developed for generation of control 
code. Some additional simple hardware devices are developed too. These devices 
provide appropriate voltage level of analogue signals which are exchanging between 
physical model of tank and control kit. Controllers are designed on the basis of the 
linear discrete-time black-box model derived from experimental data by one of the 
identification techniques described in Appendix D. The main advantage of this tech¬ 
nique is that we obtain low-order models of plant and noise. The noise model is 
used to design appropriate Kalman filter that reduces significantly the sensitivity of 
control signal to the noise, which is very important for correct exploitation of the 
actuator. Results from simulation of the closed-loop system as well as experimen¬ 
tal results obtained from real-time implementation of designed controllers are given. 
They confirm embedded control system performance in the whole working range. 

The chapter is organized as follows. In Section 5.1, we give information about 
hardware configuration of embedded system for control of water level in tank. The 
derivation and validation of water tank model are considered in Section 5.2. The model 
obtained is used to design the linear-quadratic-Gaussian (LQG) and controllers 
in Sections 5.3 and 5.4. The experimental results and comparison with simulation 
results are given in Section 5.5. The process of controller design, code generation, 
and controller evaluation is done by using MATLAB and Simulink. 


5,1 Hardware configuration of embedded control system 

The scheme of embedded system for control of water level in tank is shown in 
Figure 5.1. The system is comprised of water tank, voltage divider, DIP reed relay, and 
ARDUINO Mega 2560 kit. The aim of control is to set the water level to desired one 
regardless of amount of water which flows out through the outlet valve. The desired 



Figure 5.1 System for control of water level in tank 
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Figure 5.2 Water tank model 


level is set by reference signal, and it is achieved via manipulating inlet water flow 
by water pump. The water level is measured by filling level sensor. 

5.1.1 Water tank 

The water tank produced by Lucas Nulle Company is shown in Figure 5.2, where (1) is 
the output of liquid level sensor, (2) knobs for tuning the offset and gain of liquid level 
sensor, (3) tank with liquid level scale, (4) manual outlet valve which can be used to 
produce the load disturbance, (5) manual inlet valve, (6) flow rate sensor, (7) output 
of flow rate sensor, (8) input for manipulated variable of water pump, (9) water pump 
which pumps the water in tank from the water reservoir located at a lower altitude, 
(10) water reservoir, and (11) is the outlet valve to empty model. To control the water 
level, we change the inlet water flow by manipulating water pump voltage via input 
(8) by pulse width modulation (PWM) signal. This signal should have high level of 
10 V and low level of 0 V The water level in tank is measured by liquid level sensor 
(1), which generates output signal in range 0-10 V 

5.1.2 ARDUINO MEGA 2560 

The Arduino Mega 2560 board is presented in Figure 5.3. It is one of the most popular 
low-cost microcontroller kit [ 13 5], which can be used for automatic control of various 
plants. The Arduino Mega 2560 is a kit based on the microcontroller ATmega2560. It 
has 54 digital input/output pins, 16 analog inputs, 4 UARTs (hardware serial ports), 
a 16-MHz crystal oscillator, a USB connection, a power jack, an ICSP header, and a 
reset button. A total of 15 digital outputs can be used as PWM ones. This kit contains 
everything needed to support the microcontroller: simply connect it to a computer 
with a USB cable; power it through HOST computer USB port or with an AC-to-DC 
adapter or battery; provides various communication interfaces. The Mega 2560 board 
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Figure 5.3 Arduino Mega 2560 kit 


Table 5.1 Technical specification of Arduino Mega 2560 kit 


Microcontroller 

Operating voltage 

Input voltage (recommended) 

Input voltage limits 

Digital I/O pins 

Analog inputs 

DC current per VO Pin 

DC current for 3.3-V Pin 

Flash memory 

SRAM 

EEPROM 

Clock speed 


ATmega2560 
5 V 

7-12 V 
6-20 V 

54 (15 PWM outputs) 
16 

20 mA 
50 mA 
256 kb 
8 kb 
4 kb 
16 MHz 


is compatible with most shields designed for the Uno and the former boards. A brief 
technical specification of controller kit is given in Table 5.1. 

The ATmega2560 microcontroller has 256 kb of flash memory for storing code, 
8 kb of SRAM, and 4 kb of EEPROM. Each of the 54 digital pins on the Mega can be 
used as an input or output, using appropriate configuration functions. They operate 
at 5 V Each pin can provide or receive current of 20 mA as recommended operating 
condition and has an internal pull-up resistor (disconnected by default) of 20-50 k£2. 
The maximum current of 40 mA must not be exceeded to avoid permanent damage of 
the microcontroller. Some of digital pins have specialized functions provided serial 
communication, SPI communication, external interrupts, and PWM output. The Mega 
2560 has 16 analog inputs, each of which provide 10 b of resolution (i.e., 1,024 
different values). By default they measure from ground to 5 V 

To control the water level in tank by manipulating the water pump voltage via 
PWM signal, we should have signal with high level of 10 V and low level of 0 V 
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Figure 5.4 Voltage divider 


The 8-bit PWM signal generated by digital pin of Mega 2560 has frequency of490 Hz, 
high level of 5 V and low level of 0 V Thus, it should be amplified to high level of 10 V 
This is done by DIP reed relay. The control signal of embedded system is the integer 
number which is written to the PWM output. It can take values in range 0-255. 

The output signal of water level sensor takes values in the range 0-10 V but 
the range of ADC converter of Arduino Mega 2560 is 0-5 V Thus, the sensor voltage 
signal should be divided. This is done by the voltage divider, which linearly transform 
the sensor voltage from the range of 0-10 V to the range of 0-3.3 V The 10-bit ADC 
generates integer numbers in the range 0-1,023, but the value of voltage divider’s 
output signal which corresponds to the water level of 100 percent is approximately 

3.3 V This means that the maximum integer number obtained from ADC is 676. Thus, 
the control variable can take integer values in the range 0-676. 

The Arduino Mega 2560 board can be programed with the free Arduino Software 
(IDE) or the source code can be automatically generated and embedded in board from 
MATLAB/Simulink environment with the aid of Simulink Coder™ [9] and Simulink 
Support package for Arduino Hardware [136], 

5.1.3 Voltage divider 

The photo of voltage divider is shown in Figure 5.4. It linearly divides the output 
signal of water level sensor from the range of 0-10V to the range of 0-3.3V 
The circuit diagram is presented in Figure 5.5. Voltage divider is designed on the 
basis of TF-082 JFET-Input Operational Amplifiers and passive electronic elements 
which provide the desired characteristics. The output of voltage divider is connected 
to ADC input of Arduino Mega 2560 board. 

















Figure 5.5 Circuit diagram of voltage divider 
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Figure 5.6 Relay block 



Figure 5 .7 Diagram of relay block 


5.1.4 Relay block 

The photo of designed relay block is shown in Figure 5.6. It is based on DIP reed relay 
1A72-12L. Relay switches the supply voltage of 12 V according to PWM signal of 
5 V generated by Arduino Mega 2560 board as it is shown in Figure 5.7. The output 
of Relay block is connected to the manipulating input of water pump. 


5.2 Plant identification 

To determine the mathematical model of tank, one may apply physical modeling or 
identification. Physical modeling requires profound knowledge about physics of the 
plant and a lot of a priori information such as pump characteristics and hydraulic 
resistance of outlet valve. Due to the lack of a priori information, in this study, we 
prefer to use a numerical model obtained by identification procedure. Another reason 
to use an identification model is that such model in addition to the tank dynamics takes 
into account the dynamics of water level sensor and water pump which facilitates the 
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Figure 5.8 Simulink diagram for measuring of tank static characteristic 


plant description. Moreover, by identification, we may obtain model of the noise, 
which can be used to design an appropriate optimal filter such as Kalman filter. 

Before performing identification procedure, we should measure the plant static 
characteristics. It will show the range in which we can control the water level by 
manipulating water pump voltage via the 8-b PWM signal. To measure static char¬ 
acteristic, a specialized simulation diagram in MATLAB/Simulink environment is 
developed. This diagram is shown in Figure 5.8. It uses Analog Input block and PWM 
block from the library “Simulink support package for Arduino Hardware.” With the 
aid of Simulink Coder [9] and Simulink support package for Arduino Hardware [136], 
the code is generated from this software which is embedded in Arduino Mega 2560 
board. Configuration of properties for code generation and configuration of Arduino 
blocks will be discussed in more detail in Section 5.4. The input signal is the duty 
cycle of PWM signal, which can take values in the range of 0-100 percent. Thus, 
to transform the input signal to 8 b integer number, we should multiply it by scaling 
coefficient A pwm = 255/100. The plant output signal is the water level in tank, which 
can take values in the range of 0-100 percent too. Due to the characteristic of voltage 
divider, the maximum integer value obtained from 10 b ADC is equal to 676. This 
means that we should multiply it by scaling coefficient K out = 100/676. The static 
characteristic of plant is shown in Figure 5.9, and the steady-state values of input and 
output signals are given in Table 5.2. 

As can be seen from Figure 5.9, the plant has linear characteristics for values 
of input signal in the range 58-100 percent. The water pump has wide dead zone of 
58 percent. To use linear plant model and to control water level by linear controller, 
we should avoid the actuator dead zone. This may be done by adding the constant 
value of 58 percent to input signal. Static characteristic shows that we can control 
water level in the whole working range with duty coefficients between 59 percent 
and 100 percent. 

Plant identification is done by some of the methods described in Appendix D. The 
goal is to obtain a linear black-box model of tank which sufficiently well describes 
plant dynamics and noises in wide working range. To obtain such model first, we 
design the open-loop identification experiments. In case of step input signal water 
level achieves its steady-state value for time of approximately 300 s. Thus, we choose 
the sample time f = 0.5 s which is sufficiently small. We apply the constant input 
signal of 75 percent for first 630 s of the identification experiment. This value is 
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Duty of PWM (%) 

Figure 5.9 Tank static characteristic 


Table 5.2 Steady-state values of plant input and output 


Input signal (%) 0 20 40 50 53 56 59 62 67 77 87 

Output signal (%) 0 0 0 4 6 7 12 17 39 67 91 


approximately equal to the middle of actuator linear range. As a result, the water 
level achieves steady-state value of approximately 62 percent. After first 630 s, the 
random binary signal (RB S) is added to constant input signal which provides persistent 
excitation of identification signal. RBS is obtained from filtered through relay white 
Gaussian noise. The amplitude of RBS is chosen to be ±15 percent, so the input 
signal takes two values of 60 percent and 90 percent. In this manner, the whole linear 
range of input signal is used. The Simulink scheme for identification experiment 
code generation is Ident_tank. six. The measured input-output data are shown 
in Figure 5.10. Nevertheless, we apply only constant input signal for the first 630 s, it 
is seen that plant output is corrupted by significant noise. This noise comprises power 
supply noise, measurement noise and noise generated from A/D conversion of output 
signal. 

Before using measured input-output data for identification, we should cut the 
part of data which corresponds to the constant value of input signal, and the remaining 
one should be centered. Then, we can form two data sets first for model estimation 
and second for model validation. Next steps are to check persistence excitation level 
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Figure 5.10 Measured input-output data 


of input signal and to plot data sets (Figures 5.11 and 5.12). These are done by the 
command lines 

load('experiment_ident_tank.mat') 

y = y (3000 : end) ; 

u = u(3000:end); 

y = y-mean(y); 

u = u-mean(u); 

yestimate = (y(1000:2000)); 

uestimate = (u(1000:2000)); 

yval = (y(2001:3000)); 

uval = (u(2001:3000)); 

IdentData = iddata(yestimate,uestimate,0.5); 

ValidateData = iddata(yval,uval,0.5); 
figure() 

idplot(IdentData), grid 
title('Estimation Data'); 
figure() 

idplot(ValidateData), grid 
title('Validation Data'); 
pexcit(IdentData,1000) 















Amplitude Amplitude 


Case study 1: embedded control of tank physical model 309 


10 

0 

-10 

-20 




Time (s) 


Figure 5.11 Estimation input—output data 
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Figure 5.12 Validation input-output data 
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Figure 5.13 Hankel singular values of state-space models 


The excitation level of input signal is 500, which means that we can estimate up 
to 500 parameters from estimation data set. 

The procedure may start with estimation of simple black-box model with few 
design parameters. Such model is state-space model (D.65) in Appendix D with free 
parametrization. We choose to estimate a state-space model (D.65) because it has a 
form which can be directly used for Kalman filter design with MATLAB. Assuming 
that the possible model order is between 1 and 5, we form the model set of five state- 
space models. The order of the best model from this set is determined by MATLAB 
function n4sid with the command line 
n4 sid(IdentData,1:5) 

The resulting plot of Hankel singular values is depicted in Figure 5.13. As it is 
seen, the best model order is 1. Then, the first-order state-space model (D.65) from 
Appendix D is estimated by the command lines 

opt = ssestOptions('SearchMethod','lm'); 
sys_ss = ssest(IdentData,1,'Ts0.5,opt) 

The obtained model is in innovation form and has matrices 
A = 0.9442, B= 1.887 x HT 4 , D = 0, K = 2.89 x 10 -4 . (5.1) 

The next step is to perform validation test of estimated state-space model. The 
test of residuals is done by the command lines 
figure() 

resid(sys_ss,ValidateData), grid 

title('Residuals correlation of state space model') 
figure() 
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Residuals correlation of state-space model 



Figure 5.14 Residual test of state-space models 


resid(sys_ss,ValidateData,'fr'), grid 

title('Residuals frequency response of state space model') 

The results from whitening and independence tests are shown in Figure 5.14. 
The frequency response of the estimated high-order finite impulse response model 
between control signal and residuals along with 99 percent confidence region is 
depicted in Figure 5.15. As can be seen from Figure 5.14, the obtained model passes 
both the tests, which means that the model captures sufficiently well tank dynamics 
and the noise model is adequate. Figure 5.15 shows that there is not significant 
dynamics between input signal and residuals in the whole interested frequency range. 
The comparison between identified model output and measured water level is shown 
in Figure 5.16. It is done by command line 

figure() 

compare(sys_ss,ValidateData),grid 

title('Comparison between model and measured output signals') 

The value of metric (D.71) for water level is FIT = 15.33 percent, which at a 
first glance is not so good result, but it is seen from Figure 5.16 that the estimated 
model captures sufficiently well slow plant dynamics. This is confirmed again from 
the comparison between model step response and measured step response, which is 
shown in Figure 5.17. The measured step response is obtained for input signal of 
75 percent and the comparison is done by the command lines 

load('experiment_ident_tank.mat') 
tl = 0:0.5:0.5*999; 

y_sim = sim(sys_ss,u(l:1000)-58.5); 
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Residuals frequency response of state-space model 



Frequency (rad/s) 

Figure 5.15 Residual to input signal frequency response 


Comparison between model and measured output signals 



Figure 5.16 Model water level and measured water level 











































































































Case study 1: embedded control of tank physical model 313 


Step responses 



Figure 5.17 Model step response and measured step response 


t_sim = 0:0.5:0.5*(length(y_sim)-1) 
figure(23) 

plot(tl,y(1:1000),'k',t_sim,y_sim,'k+'),grid 

legend('Measured step response','Model step response') 

Figure 5.17 shows again that we have a significant noise in measured data. This is 
the reason for low value of metric (D.71). The Bode plot from noise (model residual) 
to model output is shown in Figure 5.18. It is done by the command lines 

sys_aug = ss(sys_ss,'augmented') 
bodemag(sys_aug(1,2)),grid 

title('Noise to model output frequency response') 

It is seen that the noise is amplified in the whole interesting frequency range. 

As a result from identification, we obtain a first-order state-space model which 
describes sufficiently well both the plant and the noise dynamics. As can be seen, the 
plant is corrupted by significant noise, but by using the noise model, we can reduce 
the influence of noise on the plant behavior. The plant dynamic model will be used 
for controller design, whereas the noise model will be used for Kalman filter design 
in the next section. 
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Noise to model output frequency response 



Frequency (rad/s) 


Figure 5.18 Noise to model output frequency response 


5.3 LQR and LQG controllers design 

The structure diagram of water level control system with LQR controller is shown in 
Figure 5.19. The design of LQR controller with integral action is done on the basis 
of deterministic part of estimated first-order tank model: 

*(* + 1) = Mk) + Bu(k) + K„e(k), 
y(k) = Cx(k) + e(k), 

where matrices A, B, and C have values from (5.1). To include integral action in LQR 
controller, the approximation of discrete-time integral of system error is regarded: 

Xj(k + 1) = xfk) + T s err(k) = xfk) + Tfr(k) - y(k)), (5.3) 

where xfk) is the integral of system error err(k) = r(k) — y(k), T s = 0.5 s is the 
sample time, and r(k) is the reference. Combining (5.2) and (5.3), one obtains the 
augmented system 

x(k + 1) = Ax(k) + Bulk) + Gr(k), 

(5.4) 

y(k) = Cx(k), 
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Figure 5.19 Water level control system with LQR controller 


where 


r m 1 

i.r ^ °i 


L *(*)_!’ 

[me i J 

L°J 



The optimal control law is obtained in the form 
u(k) = -K c x(k) + K iXi {k), (5.5) 


where K c and K t are the controller coefficients. Note that there is no need to design a 
state observer because the model (5.2) is of first order, and the state can be obtained as 
x(k) = C-'y(k). (5.6) 


The design of LQR controller is done for 


Q = 



by MATLAB file Tank_lqr_lqg_design. m. 

The presence of significant noise in measured output determines the need to 
reduce influence of noise to water level and especially to actuator. This may be done 
by Kalman filter. The structure diagram of water level control system with LQG 
controller, which comprises LQ regulator and Kalman filter, is shown in Figure 5.20. 
The designed Kalman filter is described by the following equations: 
x(k) = (A — K f CA)x(k — 1 ) + (B — K f CB)u(k - 1 ) + K f y(k), 
y(k) = Cx(k), ° n 

where x(k) is the state estimate, y{k) is the estimate of water level, and Kj is the 
Kalman filter gain. The LQG controller forms control signal according to 
u(k) = —K c x(k) + Kfdk), 

xfk + 1 ) = Hk) + T s (r(k ) - y(k))- 1 ' ' ’ 

Note that the design of Kalman filter (5.7) is performed for fictive output noise 
with small variance of 0.001 because there is no additional output noise in the 
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Figure 5.20 Water level control system with LQG controller 


Magnitude plot of closed-loop system with 
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Figure 5.21 Magnitude plot of closed-loop system 


model (5.2). The Kalman filter design is done using MATLAB function kalman 
by MATLAB file tank_lqr_lqg_design.m. 

Now we compare the properties of designed LQR and LQG controllers in both 
frequency and time domains. The magnitude plot of the closed-loop system is shown 
in Figure 5.21 and the sensitivity of control signal to model noise is depicted in 
Figure 5.22. As should have been expected, the closed-loop systems with both con¬ 
trollers have the same characteristics. This is due to the fact that the frequency 
responses are calculated for zero initial conditions. It is seen that the closed-loop 
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Figure 5.22 Control signal sensitivity to model noise 


bandwidth is approximately 0.085 rad/s, which is sufficiently larger than plant band¬ 
width. The closed-loop system will track without steady-state error reference signal 
with frequency up to 0.085 rad/s. The control signal of closed-loop system with LQR 
controller is very sensitive to noise in high frequencies. Thus, for this system, the 
noise will be amplified by controller. As a result, undesirable oscillations with signif¬ 
icant amplitude will be occurred in control signal. In real application, this may cause 
damage of actuator. On the other hand, the control signal for closed-loop system with 
LQG controller is not sensitive to model noise in high frequencies due to the filtration 
properties of Kalman filter. 

The reference signal, exact (without noise) output signal, and estimation by 
Kalman filter output signal of closed-loop system with LQG controller are presented 
in Figure 5.23. In Figure 5.24, the exact plant state and estimated one are presented. In 
Figure 5.25, control signals of closed-loop systems with LQR and LQG controllers are 
shown. It can be seen that the system with LQG controller tracks the reference signal 
in the whole working range. The settling time of approximately 100 s is achieved 
which is three times less than the one for plant step response. The overshooting 
is negligible. The Kalman filter estimates correctly plant output and state. Figure 
5.25 shows the advantages of system with Kalman filter. The control signal of LQG 
controller does not exceed 42 percent which is the maximum allowed value due to 
the water pump dead zone of 58 percent. In real experiment, we will add 58 percent 
to the control signal produced by controller. In this way, we will work only in linear 
zone of actuator. In accordance with frequency response shown in Figure 5.22, the 
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Output of closed-loop system with LQG controller 
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Figure 5.23 Exact output and estimated output signal of system with LQG 
controller 
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Figure 5.24 Exact plant state and state estimate of system with LQG controller 
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Figure 5.25 Control signals of system with LQG controller and LQR controller 


control signal of LQR controller has many high frequency oscillations and exceeds 
the maximum allowed value. As a result in real application, the damage of actuator 
can occur. 


5,4 Jifoo Controller design 

To obtain good performance of closed-loop system, we shall design a two-degree 
of freedom controller. The block diagram of control system is presented in 
Figure 5.26, where e p and e u are the weighted closed-loop system outputs and d is the 
output disturbance. The aim of controller determined by synthesis is to ensure 
stability and performance of closed-loop system in the presence of disturbance and 
to provide good tracking of reference in whole working range. For simplification of 
design procedure, we do not take into account the model noise e(k), but this noise 
will be used in performance analysis of the closed-loop system. In order to obtain 
better tracking of reference, the integral of system error is introduced in controller. 
To embedded the designed controller in Arduino Mega 2560 board the discrete-time 
synthesis is done with sample time 0.5 s. 

Let 


y c = \y n 


(5.9) 
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Figure 5.26 Block diagram of closed-loop system in case of Mf controller design 


is the output feedback vector, where y m = y + d is the measured output and the 
quantity 


err m 


Wm 


= wur-ym), 

T s 

z- 1 


(5.10) 


is the discrete-time integral of system error. Assume that the controller transfer matrix 
K is represented as 

K=[K r K yc \, (5.11) 

where K r is the controller prefilter transfer matrix and 

K yr = [K y K mt ], (5.12) 

is the output feedback transfer matrix. The matrix K c is partitioned with respect to 
the dimensions of y m and err mt . Then, the control action and measured output are 
calculated from the following expressions: 



| = K r r + K y y m + K mt err mt , 
y m = Gu + d. 


(5.13) 


It is easy to show that the weighted closed-loop system outputs satisfies the equation 



' W P S X W p ( 1 + S2) 

T c i = W Pint W ml (l - - W Pm W mt (\ + S 2 ) 

_ W u (K r + K mt WU 1 + -Si) W u {Ky + K m W mt )(\ + S 2 ) 

where 

G(K r + K mt W mt ) G(K y - K mt W mt ) 

1 _ 1 + G(K mt W mt - K y ) ’ 2 _ 1 + G(K mt W mt - K y )' 


(5.14) 


(5.15) 
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As usual, the controller design problem is to find stabilizing suboptimal 
controller K, such that 


(5.16) 


where T cl is the transfer matrix from exogenous input signals r and d to the output 
signals e p , e- mt and e u , and y > y m \ n . The positive scalar y mm is the minimum value 
of || T c | Hoc over all stabilizing controllers K. The weighting transfer function matrices 
W p , W Pjnt , and W u reflect the relative importance of the different frequency ranges for 
which the performance requirements should be fulfilled. Determination of stabilizing 
controller^ for y < 1 means that the performance requirements imposed by transfer 
matrices W p , W Pmt , and W u are satisfied. The controller design is done with 
MATLAB file Tank_Hinf_design .m using the MATLAB function hinfsyn. 
The procedure is performed for various choices of performance weighting functions. 
After several trials, the performance weighting functions (in the continuous-time case) 
are chosen as 

°' 5 ^, W p . =0.03, ^= 2( * +10Q) . 

I- 0.24 Pwt 5+1,000 


W B = - 


(5.17) 


As can be seen from expression (5.17), the transfer function W p is chosen as 
low-pass filter. The transfer function W Pjnt is chosen as constant, which does not 
increase the controller order. The transfer function W u is chosen as high-pass filter 
with appropriate bandwidth in order to impose constraints on the spectrum of con¬ 
trol action. After minimization of norm (5.16), we obtain a fourth-order stabilizing 
controller for y = 0.9997. This means that the performance requirements are 
satisfied. 

The comparison of designed and LQG controllers in both frequency domain 
and time domain is performed. The magnitude plot of the closed-loop system for 
both controllers is shown in Figure 5.27. The sensitivity of control signals to model 
noise for both controllers is depicted in Figure 5.28. It is seen that the bandwidth of 
system with controller is approximately 0.11 rad/s, which is higher than one of 
the system with LQG controller. This means that the step responses of system with 
controller will be faster than one of the system with LQG controller. The control 
signal of closed-loop system with controller is more sensitive to noise than one 
of the system with LQG controller. This may cause oscillations of control signal. 

The reference and the exact (without noise) output signals of closed-loop system 
with and LQG controllers are presented in Figure 5.29. In Figure 5.30, control 
signals of the same closed-loop systems in the case of model noise e(k ) according to 
(5.2) are shown. 

It can be seen that both systems track very well reference signal in whole working 
range. The step response of system is faster than one of the LQG system which 
is in accordance with system bandwidth. The system achieves settling time 
of approximately 70 s without overshooting, which is important according to plant 
physics. The control actions of both systems are similar. They do not exceed the 
maximum allowed value of 42 percent. The control action of system has larger 
oscillations than one of the LQG system which is due to sensitivity demonstrated in 
Figure 5.28. 
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Figure 5.27 Magnitude plot of closed-loop system 
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Figure 5.28 Control signal sensitivity to model noise 
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Outputs of closed-loop system with Hinf and LQG controllers 
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Figure 5.29 Exact output signals of system with -FLf and LQG controllers 
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Figure 5.30 Noised control signals of system with and LQG controllers 
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5.5 Experimental evaluation 

The specialized software in MATLAB/Simulink environment is developed to imple¬ 
ment the water level control code for the designed LQG and controllers. With 
the aid of Simulink Coder [9], Embedded Coder [34], Arduino IDE 1.6.12 [137], 
and Simulink Support Package for Arduino Hardware v.16.1.2 [136] a code is gen¬ 
erated from this software which is embedded into the microcontroller ATmega2560. 
The main advantages of code generation technology are the very short time for cod¬ 
ing of control algorithm, reducing the overall time for testing and verification of 
the developed algorithm, and the relatively easy implementation of complex control 
algorithms. The block diagram of the software to generate code for water level LQG 
control is shown in Figure 5.31. 

The diagram in Figure 5.31 includes the blocks “Analog input” and “PWM” 
which are taken from the specialized library “Simulink Support Package for Arduino 
Hardware.” To generate code for Arduino hardware some additional configurations 
of Simulink diagram should be done. They are performed via “Configuration param¬ 
eters” menu shown in Figure 5.32, which is achieved through “Simulation menu.” 
First the user should choose a hardware board, for example, “Arduino Mega 2560” 
as it is shown in Figure 5.32. Next step is to configure some specific properties such 
as build options, host-board connection, external mode, and others. To generate and 
embed code in microcontroller and to run this code a build options should be chosen 
as “Build, load, and run.” The host-board connection should be configured too. In 
our case connection is via USB interface and Windows discovers a hardware board as 
device which is connected via some virtual COM port. Then, the number of virtual 
COM port from “Host board connection menu” (Figure 5.33) should be the same 
as one from Windows Device Manager. To exchange the data between host PC and 
Arduino board, the Simulink model should be run in “External mode.” This mode 
allows to change in real-time values of variables in control program and to obtain 
real-time data from microcontroller. When the hardware is connected to host PC via 
USB interface, the communication mode of property “External mode” should be set 
to “Serial” as it is shown in Figure 5.34. Simulink Coder uses information from “Con¬ 
figuration parameters” menu to properly simulate model and to generate executable 
code for the particular work environment. 

The analog input block in the diagram depicted in Figure 5.31, whose interface is 
shown in Figure 5.35, is used to set the ADC output channel number (pin number) and 
sample time. The PWM block, whose interface is shown in Figure 5.36, is used to set 
the PWM output number. The generated signal has the frequency of approximately 
490Hz. The analog input block gives the number of type uintlO, i.e., a number 
between 0 and 1,023. This number presented information of actual water level. To use 
it in control algorithm, it should be converted to double type and appropriate scaling 
should be performed. Due to static characteristic of voltage divider, the obtained 
uintlO number, which corresponds to water level of 100 percent, is 676. Thus, 
the scaling coefficient which transform obtained integer number to water level is 
Wvi = 100/676. The PWM block accepts as input the integer numbers between 0 and 




Figure 5.31 Simulink block diagram to generate code for LQG controller 


mi A * 1 




















326 Design of embedded robust control systems using MA TLA B^/Simulinlf' 



255. An input value 0 produces 0 percent duty cycle, and an input value 255 produces 
100 percent duty cycle. The control signal is number of type double between 0 percent 
and 100 percent. This number should be transformed to uint8 type and should be 
scaled. Thus, the scaling coefficient is K pv/m = 255/100. 

Note that the maximum number obtained from ADC is 676, which means that in 
feedback we use only approximately 9 b instead of the possible 10 b. As mentioned 
previously, the static characteristic of water pump has dead zone of approximately 
58 percent. To work in linear range of the actuator, a constant value of 58 percent 
is added to control signal produced by the controller. Then, the controller produces 
signal in the range 0-42 percent which corresponds to 107 different values of duty 
cycle. Thus, we control a water level by approximately 7 b PWM instead of 8 b one. 

Several experiments with controller designed are performed. Duration of every 
experiment is 2,500 s. The reference signal is varying in wide working range according 
to expression 

40%, 0 < t < 500, 

60%, 500 < t < 1,000, 

r = 80%, 1,000 < t < 1,500, (5.18) 

45%, 1,500 < t < 2,000, 

60%, 2,000 < t < 2,500. 

First consider experiment with LQG controller. The comparison between results 
from experiment and simulation is done. The reference signal, the estimated by 
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Block Parameters: Analog Input j 

Arduino Analog Input (mask) (link) 

Measure the voltage of a specified analog input pin. The block 
represents the voltage as a digital value (0-1023, minimum to 
maximum). The maximum voltage is determined by the analog input 
reference voltage. 

Enter the number of the analog input pin. Do not assign the same pin 
number to multiple blocks within a model. 


Parameters 
Pin number: 


s 

Sample time: 


[ OK 1 [ Cancel J Help ] ( Apply 


Figure 5.35 Analog input block interface 
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Figure 5.36 P WM block interface 


Kalman filter water level from experiment and exact (without noise) water level 
from simulation, are shown in Figure 5.37. The exact control signal from simulation 
and the control signal from experiment are depicted in Figure 5.38. In Figure 5.39, 
the measured output and estimated output from experiment are presented. It is seen 
that there are very significant noise in measured output signal. This noise comprises 
of measurement noise, noise from power supply, and noise from ADC conversion. 
Nevertheless, the Kalman filter smooths out very well system output (see Figure 5.39), 
which means that the obtained by identification model is adequate. This statement is 
confirmed by excellent closeness between exact output from simulation and estimated 
output from experiment (see Figure 5.37). The control system with LQG controller 
has very good performance for the whole working range. The settling times of all 
transient responses depicted in Figure 5.37 are approximately 70 s, which is four 
times shorter than duration of plant step response. The overshoot is negligible. This 
is very important for tank, because overshoot means that extra quantity of water will 
flow through tank. As a result from filtration of output signal and plant state, the 
control signal has sufficiently small oscillations. Thus, the actuator works properly 
and safely. The control signal does not achieve maximum value of 100 percent. 

Let us consider the results from experiment with controller. In Figure 5.40, 
the reference, the output signal from experiment and exact (without noise) output 
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LQG output signal 



LQG control signal 



Time (s) 


Figure 5.38 Control signals from experiment and simulation for LQG system 
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LQG measured plant output 



Time (s) 


Figure 5.39 Measured output and estimated output for LQG system 


Output Hinf controller 



Time (s) 


Figure 5.40 Measured output and simulated output for system 
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Hinf control signal 



Time (s) 


Figure 5.41 Measured control action and simulated control action for , system 


signal from simulation are presented. In Figure 5.41, the control signals from experi¬ 
ment and simulation are depicted. As can be seen again, the measurement noise is very 
strong. Nevertheless, the output tracks very well reference signal and again the set¬ 
tling time is sufficiently small, and there is no overshoot of transient response. Again 
the experimental results are very close to the ones from simulation without noise. 
Though the system has no Kalman filter, control signal has no large oscillations. This 
is due to the fact that we have observer which is part of . controller. It estimates 
plant states and uses these estimates in feedback. This observer has similar equation 
as one of the Kalman filters [see (4.39)]. For comparison purpose, the measured out¬ 
put signal of system with Mf controller is filtered off-line (after experiment) with 
the Kalman filter used for LQG control. The comparison between estimated output 
signal for system with LQG controller and filtered output signal of system with 
controller is presented in Figure 5.42. 

As can be seen from Figure 5.42, the output signals are very similar. For most of 
the transient responses, the settling time of system is slightly less than the one 
of LQG system. For example, the transient responses in the time range 500-1,000 s 
have settling times of approximately 60 s for Mf system and of approximately 70 s for 
LQG system. Moreover, all the transient responses of system have not overshoot. 
Comparing the orders of LQG and controllers, the LQG controller has advantage. 

The order of LQG controller is 2, while the order of controller is equal to 4. 
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Output of Hinf and LQG controllers 



Time (s) 

Figure 5.42 system-filtered output and LQG system estimated 


5.6 Notes and references 

The control of liquid level in tank is a problem that commonly occurs in lot of industrial 
applications. These applications are related to the food processing, chemical industrial 
processes, agriculture, and nutrition. Due to that, the system for automatic liquid level 
control is one of the popular experimental setups in industrial control and embedded 
control laboratories, see for instance Ogata [68] and Slavov and Puleva [138], The 
popularity and practical significance of liquid level control problem motivated the 
authors to design a low-cost embedded system for control of liquid level in a physical 
model of tank. 
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Chapter 6 

Case study 2: robust control 
of miniature helicopter 


The aim of this case study is to present in detail the /x synthesis of a high-order inte¬ 
gral attitude controller of a miniature helicopter and to demonstrate results from the 
hardware-in-the-loop simulation of the helicopter control system. The /x controller 
designed for hovering allows to suppress efficiently strong wind disturbances in the 
presence of 15 percent input multiplicative uncertainty. A simple position controller 
is added to ensure tracking of a desired trajectory in the 3D space. The results from 
hardware-in-the-loop simulation are close to the results from the double-precision 
simulation of helicopter control system in Simulink®. It is shown that even for large 
deviations of the helicopter variables from their trim values in hovering the con¬ 
trol system has acceptable performance. The software platform developed allows to 
implement easily different sensors, servoactuators, and control laws and to investigate 
the closed-loop system behavior in the presence of different disturbances, noises, and 
parameter variations. 

The helicopter controller is designed under the following assumptions: 

• The helicopter model is linearized around the trim conditions for hovering so 
that the resulting linear system is time invariant, i.e., the plant parameters are 
considered as constant. 

• There is an uncertainty in the mathematical description of the helicopter due to 
approximation errors, neglected dynamics, and nonlinearities which is taken into 
account by adding multiplicative uncertainty at the plant input. 

• It is assumed that the angles and rate measurements are obtained from an inertial 
navigation system (INS) and smoothed by Kalman filter so that the effect of 
measurement noises on the control system is small in comparison with the wind 
disturbances effect. That is why these noises are neglected in the design but are 
taken into account in the simulation of the closed-loop nonlinear system. 

The controller design is done on the basis of the sophisticated nonlinear model of 
the miniature helicopter X-Cell 60 SE presented in [139], An analytically linearized 
model of the miniature helicopter is derived which is verified by comparison of its 
frequency responses with the responses of the numerically linearized model. The /x 
controller is implemented by Digital Signal Processor (DSP) whose performance is 
tested on a Simulink model of the nonlinear helicopter plant under the action of wind 
disturbances and sensor noises. The results from hardware-in-the-loop simulation of 
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the helicopter control system confirms the controller ability to ensure good transient 
responses in the presence of parameter changes and sufficiently strong disturbances. 

The chapter consists of three sections. In Section 6.1, we present the helicopter 
model that is used in the controller design and in the simulation of the closed-loop 
system. First, a nonlinear 13th-order model is described after that its analytical and 
numerical linearization are discussed. An uncertain linear helicopter model is con¬ 
sidered with input multiplicative uncertainty that may reach 15 percent. This model 
is used in Section 6.2 to design a /x controller that stabilizes the angular helicopter 
motion. The /x controller ensures robust stability and robust performance of the uncer¬ 
tain closed-loop system. A simple proportional-derivative regulator is designed to 
implement the position control of helicopter center of mass. Results from hardware-in- 
the-loop simulation of the integral helicopter controller under the action of moderate 
wind disturbances are presented in Section 6.3 for a circular motion in the 3D space. 
The HIL simulation is done by using a digital signal controller and allows to reveal 
the accuracy of the actual control algorithms as well as to check the nonlinear system 
performance for different disturbances, noises, and parameter values. 

The presentation in this chapter is based on the paper [140], 

6.1 Helicopter model 


MATLAB® files used in this section 


File 

Description 

heli_model.m 

S-function to model the nonlinear helicopter 
dynamics 

trim_val_heli.m 

Finds the trim values of helicopter variables 

lin_heli_model.m 

Computes analytically linearized helicopter 
model 

num_lin_he1i.m.m 

Numerical linearization using Simulink 
helicopter model 

comp_freq_heli.m.m 

Comparison of frequency responses of linearized 
helicopter models 

mod_heli.m 

Uncertain linear helicopter model 


6.1.1 Nonlinear helicopter model 

In this chapter, we use the analytic nonlinear model of highly maneuverable minia¬ 
ture helicopter with a main rotor and a tail rotor, presented in [139], It contains the 
rigid-body helicopter dynamics, dynamics of the longitudinal, and lateral main rotor 
flapping, the rotor speed, and an integral of the rotor-speed tracking error used in the 
engine governor. Simplified expressions are used to determine the component forces 
and moments acting on the helicopter. A momentum theory-based iterative scheme 
adopted from [141] is used to compute the thrust coefficient and inflow ratio as a 
function of the airspeed, rotor speed, and collective pitch angle. The resulting heli¬ 
copter model is of 13th order with notion given in Table 6.1. In this section, we present 
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Table 6.1 Notation 


Symbol 

Quantity 

Units 

0, 9, i/s 

Roll, pitch, and yaw angles 

rad 

P, <b r 

Roll, pitch, and yaw rates 

rad/s 

U 9 V, w 

Longitudinal, lateral, and normal velocities 

m/s 

V X , Vy, V Z 

Velocities in Earth fixed north-east-down 
(NED) frame 

m/s 

v = + Vj + V 

Total velocity 

m/s 

x,y,z 

Position coordinates in NED frame 

m 

q 

Direction cosine matrix from body frame 
to NED frame 


h 

Flight altitude, h — |z| 

m 


Longitudinal and lateral flapping angles 

rad 

Urnr, Cimm, 

Main rotor speed, nominal main rotor speed, 
and main rotor-speed reference 

rad/s 

a>i 

Integral of the main rotor-speed tracking 

rad 

T m 

Main rotor thrust 

N 

X, Y,Z 

Forces applied along the X, Y, and Z body 
frame axes 

N 

L,M,N 

Moments about the X, Y, and Z body frame 

Nm 

Qe,Qmr,Q* 

Engine torque, main rotor torque, and tail 
rotor torque 

Nm 

pmzx 

Engine max power 

W 

Scol 

Collective pitch angle of the main rotor 
blades 

rad 

Sion, Sl a t 

Cyclic pitch angles of the main rotor blades 

rad 

5tr 

Pitch angle of the tail rotor blades 

rad 

s t 

Engine throttle setting 

rad 

“wind, Wind, Wwind 

Wind velocities along X, Y, and Z body frame 

m/s 

m 

Helicopter mass 

kg 

g 

Acceleration of gravity 

m/s 2 

P 

Air density 

kg/m 3 

4t> lyy, /-- 

Rolling, pitching, and yawing moments of 

kg m 2 

Yjb 

Stabilizer bar Lock number 


R mr 

Main rotor radius 

m 

Tot 

Total main rotor moment of inertia 

kg m 2 

R a 

Tail rotor radius 

«tr 

Gear ratio of tail rotor to main rotor 


f^a 

Advance ratio 


Vz 

Normal airflow component 


^^ion » ^$]at 

Steady-state longitudinal and lateral gains 
from the cyclic inputs to the main rotor 
flapping angles at nominal main rotor 
speed 

rad/rad 
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Table 6.1 (Continued) 


Symbol 

Quantity 

Units 

r e 

Rotor time constant for a rotor with 
stabilizer bar 


K p 

Proportional engine governor gain 

s/rad 

Ki 

Integral engine governor gain 

1/rad 


Transfer functions of collective and 
cyclic servos 


<ervo 

Transfer function of the tail collective 


Xh 

State vector of the linearized model 


yh 

Output vector of the linearized model 



Controller output vector 


u s 

Servoactuator output vector 


Kp\ > Kp2,Kpi, 

Proportional coefficients of the position 

PD regulators 


Ka\,K d2 ,K di 

Derivative coefficients of the position 

PD regulators 


U Z ,U X ,Uy 

Position controller outputs 



only the main equations describing the nonlinear helicopter dynamics referring the 
reader to [139,142] where detailed description of the miniature helicopter model and 
its parameters identification are given. 

The main variables which characterize the helicopter motion in body frame coor¬ 
dinate system are shown in Figure 6.1. The Newton-Euler equations that describe the 
rigid-body translational and angular helicopter motions are taken neglecting the cross 
products of inertia. 

Equations for translational velocities. 
u = vr — wq — g sin((9) +X/m 

v = wp — ur + g sin(0) cos (0) + Y/m (6.1) 

w = uq — vp + g cos (0) cos(0) + Z/m. 

Equations for angular rates. 

P = qr(Iyy — hz)/lxx + L/ 4v 

q = pr(fz ~ lxx)/1yy + M/Iyy (6.2) 

f = pq(I xx - I yy )/I zz + N/L z . 

Equations for Euler angles. 

<fi = p- sin(0)tan(0)<y + cos(</>)tan(0)r 

9 = cos (f)q — sin (0)r (6.3) 

i]f = (sm((p)/cos(0))q + (cos(<£)/cos(0))r. 

The forces X, Y, Z are expressed as 

x = x mr +x flls , r.=. T mr + y fus + y„ + T vf , z = z mr + z fhs + z ht , 
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Figure 6.1 Helicopter variables in body frame coordinate system 


where the subscripts mr, fus, tr, vf and ht show that the corresponding force component 
pertains to the main rotor, fuselage, tail rotor, vertical fin, and horizontal stabilizer, 
respectively. The force components pertaining to the main rotor are functions of the 
main rotor thrust T mr and the flapping angles a\,b\, 

X mr = —T mr sin(ai), sin(bi), = — 7’ mr cos(ai)cos(Z)i). 

The main rotor thrust is determined from 
T m = C T p(Q mr R mr ) 2 7v R 2 mr , 

where the thrust coefficient Ct is a function of the collective pitch angle <5 co i, the 
advance ratio 

da = V( u ~ “wind) 2 + (V - V wind ) 2 /(fi mI i? mr ) 
and the normal airflow component 
dz = (v~ v wind )/(fi mr i? mr ). 

The above expressions show that the main rotor thrust and hence the associated force 
components depend strongly on the wind velocities v^, w willd . The fuselage 
forces Xfljs, T fus ,Z fus as well as the sideforce T vf produced by the vertical fin and 
the force Z ht generated by the horizontal stabilizer depend on the fuselage center of 
pressure velocities u - w wind , v - v wind , w - w wind . The tail rotor thrust is determined 
similarly to the case of main rotor thrust and depends on the pitch angle «5 tt of the tail 
rotor blades as well as on the wind velocities. 

The moments along the X,Y,Z axes are represented as 

1 = ^+1^+^, M = M mi + M ht , N = -Q e +N yt +AV, 
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where the main rotor rolling moment L mr and the pitching moment M mr are functions 
of the main rotor thrust and the flapping angles, Q e is the engine torque (positive 
clockwise), the rolling moment L vf and the yawing moment N vf are proportional to 
the sideforce 7 vf produced by the vertical fin, the rolling moment L u and the yawing 
moment N ir are proportional to the tail rotor thrust Y tr and the pitching moment M ht 
is proportional to the force Zh t generated by the horizontal stabilizer. 

Detailed description of the component forces and moments that act on the 
helicopter body may be found in [139,141,143], 

The main rotor dynamics is modeled by the following equation: 

Ar = r + (Qe ~ Qmr - n tr Q tr )/ T m . (6.4) 


In this equation, the engine torque 



can be changed by varying the engine throttle setting 8 t , the yawing moment produced 
by the main rotor being given by 

Q m = Cgp(J2 mr i? mr ) 2 rri?^ r , 

where C'q is the torque coefficient and the tail rotor torque is determined as 


Qtr = C QtI p(Q tr R tr ) 2 7vRl, 


where Cgtr is the tail rotor torque coefficient. 

The rotor speed is stabilized by using an engine governor that implements 
proportional-integral feedback controller described by 

The longitudinal and lateral flapping dynamics of the main rotor, taking into 
account the effect of the wind, is represented by the two first-order differential 
equations 


di = -q + (-a x 
bi = -p + {-b x 


9 fll U W w ind 9 «i W VV w i nc l 


9/r a Q mr R mr dji : Q mr R lm 
db x v — v wind | 

9/r v + ^ e ’ 


+ ^«lon^lon)/^e 


( 6 . 6 ) 


where the steady-state longitudinal and lateral gains from the cyclic inputs to the main 
rotor flap angles are determined by 


Aon = A°:(£WC!nom) 2 , 

A, = 
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The flapping derivatives ( dai/dp a ),(dbi/dp. v ) = (-3ai/3/r a ),(3ai3/r z ) in respect 
to the advance ratio /i„ and normal airflow component p z , respectively, are found by 
the simplified expressions given in [139] and 
16.0 

To control the helicopter velocity and position, we shall need also the relationship 
between the velocities in body fixed reference frame and Earth fixed (i.e., inertial) ref¬ 
erence frame. Define the direction cosine matrix, used to transform a vector expressed 
in the body frame to a vector expressed in the inertial frame, as 
cdcty s<j)s6c\jf — c<ps\lf c4>s6c\lr + s<j>si/f 
Cl = cOsi/f sfsBs^r + cfpcxlf cfsBsi/s — s4>c\lr , 

—sB sipcd c<pcB 

where 5 and c denote sin(-) and cos(-), respectively. Then, the necessary relationship 
is written as 


(6.7) 


The position coordinates in north-east-down (NED) frame are determined from 

x=V x , y=V y , z = V z . 

The nonlinear helicopter model represented by (6.2)-(6.7) is implemented as the 
MATLAB S-function heli_model which is used in trimming and numerical plant 
linearization. 

The helicopter control is done by signals to servoactuators which change in 
appropriate way the control actions <5 co i,<5i 0 n,3iat, and <V- The servos for collective 
and cyclic angles are assumed to have the same transfer functions 

_ s/T z + 1 co 2 n 


' v x ' 


" u~ 

V v 

= c b 

V 

v z 


- w . 


^servoOO = WseLCO = tCrofa) = 
while the tail servo transfer function 


s/T p + 1 s 2 + 2i;co n s + a 
rvo is taken as 


( 6 . 8 ) 


^fervoOO = 2 , * -T-2 • 

S 1 + 2 ^( 0 ^ + £ 0 £ 

The parameters of the servoactuators are taken from [139]: 


(6.9) 


T z = 104, T p = 33, a>n = 36, = 14jr, f = 0.5, & = 0.6. 

The helicopter dynamics, described by (6.2)-(6.7), is combined with the 
dynamics of the servoactuators to obtain the extended plant dynamics shown in 
Figure 6.2. 


6.1.2 Linearized model 

Equations (6.2)-(6.6) are linearized analytically to produce a time-invariant state- 
space model, needed in the attitude controller design. The linearization is done by 
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Helicopter 

dynamics 


Figure 6.2 Extended helicopter dynamics 


taking the linear terms of the Taylor series expansion in the arguments of the deviation 
Av = v — v tnm of each variable v from its trim value v lr,m . This requires computation 
of the partial derivatives that determine the linear terms of the expansion in respect to 
the corresponding arguments. The linearization is done for hovering after finding the 
trim values of the state and input vector components from the nonlinear helicopter 
model using the MATLAB function trim_val_hel i utilizing the nonlinear model 
heli_model. Since there is some freedom in determining the trim values, we set 

u mm = 0.001 m/s, v mm = 0.001 m/s, w trim = 0 m/s, £2^“ = 167 rad/s. 

Note that the values of u‘ nm and v' nm are set slightly greater than zero to avoid numer¬ 
ical difficulties during trimming. As a result, we obtain the following trim values 
corresponding to hovering: 

p mm = 0 rad/s, q tnm = 0 rad/s, r lr,m = 0 rad/s 

4> lrm = 0.0873 rad, 6 ,nm = —3.3 x 10 -6 rad, f tnm = 0 rad 

(J[ im = 29.17 rad, af m = 0 rad, b\ nm = 8.48 x 10 -3 rad 
and 

<5'7 = 0.0967 rad, S‘™ = 0.0 rad, <5f j* = 0.020 rad, S‘" m = -0.2488 rad. 

We note that the large value of the trim value of the tail rotor blades pitch angle is due 
to the necessity to counteract the main rotor torque in order to stabilize the helicopter 
body along Z axis. 
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Simplifying the presentation, the linearization of (6.2)-(6.6) is done as follows. 
Taking into account that in steady state it is fulfilled that p = q — r = 0, (6.2) is 
linearized as 


A u = vAr — wAq — g cos(0) A 9 + AX/m 

Av = wAp — uAr + g cos (f) cos(0)A0 — g sin(0) sin(0)A0 + AY/m (6.10) 

Aw = uAq — vAp — g sin(0) cos(0)A0 — g cos(0) sin(0)A0 + A Z/m 

where the linear terms in the forces expansion are given by 


AX = X u Au +X" wind Aw wind +X v Av +X Vwtad Avwind + X W Aw + X Wwilld Aw win d 
+X n ™A£2 mr + X &m ' A5 col + X at Aa\ 

AY = Y u Au + 7“™ d A« wind + 7 v Av + 7 v ™ d Av wind + 7 w Aw + 7 w ™ d Aw wind 
+ Y p Ap + Y q 8q + Y r Ar + 7 nmr ACl m + Y s °°‘ A«5 col + Y s « AS* + Y bl Ab x 
A Z = Z u Au + Z"™ d AM^d + Z y Av + Z Vwind Av win d + Z”’Aw + Z Wwind Aw win d 
+ Z q 8q + Z a ™ AQm + Z Sml A8 co i + Z a1 Aai + Z b1 Ab x 


and the partial derivatives are computed for the trim values of the variables shown in 
superscripts. The expressions for these derivatives are involved and may be found in 
the file lin_heli_model. 

After linearization, (6.3) takes the simple form 


AM 

A<1= ^ 


( 6 . 11 ) 


where 

A L = L u Au + L UwM Aw wind + L y Av + L Vwini Av win d + L w Aw + L Wy,imi Aw win d 
+ IP Ap + IP8q + L' Ar + if 2 ™ 1 ASl^ + Z/ 001 A<5 co i + L bti A S* + L bl Ab \, 
AM = M u Au + M Uwini Aw W i n d + M v Av + M Vwini Av^nd + M w Aw + M Wwini Aw W i„d 
+ M“8q + M^AQ^ + M 8 ™' AS col + M“> A a x , 

AN = N u Au + N Uwini Am^ + N v Av + N Vvini Av wind + N w Aw + N Wwini Aw wlIld 
+ N p Ap + N q 8q+N r Ar + N a ‘ A £2 C + N* 1 ™ AQ mr + N Sml AS col + N Sb AS*. 
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Equation (6.4) for the Euler angles is linearized as 
A<p = Ap + sin(</>) tan(0)A<y + cos((/>) tan(0) Ar 

AO = cos{(j))Aq — sin(0)Ar (6.12) 



After linearization, (6.4) takes the form 

= QFAu + £l UwimI AM wind + Q v Av + ^ Vwind AVwind 


+ £2 w Aw + Sl^Aw^j + OF Ap + Q. q A q + S^Ar (6.13) 
+ Q. n ™ AJ2 mr + fT'Aft); + QP C AQ. C + A<5 col + £2^ A K- 
Finally, the linearized equations (6.6) for the flapping angles are obtained as 


Adi = — Aq — Aai/x e + 


3fli A u — Aw wi nd 
Jtx a Q mr R mr 


dai Aw - AwwukA 
dp : Q mr R mr ) 71 


\ 3 Pa 3 mu z 

+ Z4™”£2 mr 5 lon /(r e ^ om )A£2, 


1 AQ mr /r e +d”°JA3 lon /r e 


Adi = -Ap - Ab\jx e - 


( 3di Av — Av W u 


3di 


) AQ mr /i e 


\ 3 ix v Q mr R mr 3 p, v Q. 2 mr R mr 

+ 5™-AS lat /r e + 2S^Q mr 5 lat /(r e Q n 2 om )AQ. 

Define the state vector as 

Ax h = [Am, Av, Aw, Ap, Aq, Ar, A<p, AO, Af, A^^, Awj, Aa\, Adi] r , 
the control vector as 

A u s = [A<5 col , AS lon , A3j at , A3 te ] r , 
the disturbance vector as 

A dist = [AM wi „d, Avwind, Aw wW ] r , 
and the output vector as 

A yi, = [Ad, Av, Aw, Am, Av, Aw, Ap, Aq, Ar, Af, AO, Ar/r, a\, b\\ T . 
Then, (6.10)-(6.14) are represented as the linearized helicopter model 


Aku = AAxh + B 


Ay h = CAx h + D 


AQ C 

Adist 
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Table 6.2 Basic helicopter parameters 


Parameter 

Value 

Parameter 

Value 

m 

8.2 kg 

Rrm 

0.775 m 

Av 

0.18 kg m 2 

Rtr 

0.13 m 

lyy 

0.34 kg m 2 

«tr 

4.66 

4 

0.28 kg m 2 

a™ 

4.2 rad/rad 

Act 

0.095 kg m 2 

B s,7 

4.2 rad/rad 

Yjb 

0.8 

Kp 

0.01 s/rad 

Q nom 

167 rad/s 

Kt 

0.02 1/rad 


where A, B, C, and D are matrices with dimensions 13 x 13, 13 x 8, 14 x 13, and 
14 x 8, respectively. In this way, for small deviations from trim conditions, the heli¬ 
copter dynamics is described by a linear model of 13th order with 8 inputs (5 control 
actions and 3 disturbances ) and 14 outputs. For simplicity, further on the symbol A will 
be dropped out remembering that the elements of the vectors xj,, u s , yt, represent the 
deviations of the corresponding variables from their trim values and that the elements 
of the matrices A, B, C, D are computed for the trim values of the variables involved. 
The linearized helicopter model is obtained by the M-function lin_heli_model. 
The computations are done for the parameters of the X-Cell 60 SE Helicopter given 
in [139], The basic helicopter parameters are presented in Table 6.2. 

Equation (6.15) may be represented in the frequency domain as 


y h (s) = G heli 


«,C0 ' 
to c (s) 
dist(s) 


(6.16) 


where the helicopter transfer function matrix Gh e ii is determined by the matrices 
A,B, C,D as 


G he n(s) = C(sI-A)- ] B+D. 


The linearization of the helicopter model requires a large volume of computations 
by hand which may be accompanied with errors. That is why the model obtained is 
checked by a numerical linearization using the Simulink model 1 inmod_hel i .six 
build on the basis of the S-function heli_model. The numerical lineariza¬ 
tion is performed using the M-function num_lin_heli which implements the 
MATLAB function linmod. 

The advantage of the analytical linear model over the numerical one is that 
it allows to compute easily the model matrices for a given set of the helicopter 
parameters. Also, this description may be used to obtain the so-called parameter- 
dependent model [112, Chapter 2] which depends on parameters like velocity and 
altitude that may undergo large variations along the time. 

The analytically linearized helicopter model (6.15) is verified by comparing the 
frequency responses of the individual input/output channels with the corresponding 
frequency responses of the numerically linearized model. 
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Helicopter frequency responses 



Figure 6.3 Frequency responses of analytical and numerical linearized 
models—control actions to 0 


The frequency responses corresponding to the transfer functions from control 
actions and disturbances to the Euler angles for the analytical and numerical linearized 
models are obtained with the M-file comp_freq_heli. In Figures 6.3 and 6.4, we 
show a comparison of the frequency responses in respect to angle 9 for both models. 
It is seen that the frequency responses of the models practically coincide. 

It is necessary to point out that the analytically linearized helicopter model may 
be used not only for hovering but also for different translational velocities provided 
that the corresponding trim conditions are preliminary found. 

6.1.3 Uncertain model 

Equation (6.16) is considered as the nominal model of the helicopter dynamics. To 
account for the neglected helicopter dynamics, approximation errors, and changes 
of the trim conditions, we add multiplicative uncertainty to each component of the 
control vector u s as shown in Figure 6.5. Each quantity <5,, i — 1,... ,4 is supposed 
to be a gain bounded uncertain linear time-invariant object that satisfy 

141 <0.15, i = 1,..., 4. 

In this way, the uncertainty in each control component may reach 15 percent. More 
uncertainty allows to take into account larger model errors, parameter changes, 
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Helicopter frequency responses 

From: « win( j From: v wind From: w vAnA 




Frequency (rad/s) 


Figure 6.4 Frequency responses of analytical and numerical linearized 
models—disturbances to 9 


and nonlinearities, but it becomes more difficult to confront it with a single time- 
invariant controller. Note that the uncertainties do not vary over the frequency which 
is somewhat a conservative assumption. The reason for this assumption is the lack of 
knowledge about the model accuracy over the frequency range. The resulting uncertain 
plant is described by the transfer function matrix 


G(s) = Gm(s) 


1+5, 

0 

0 

0 

0 

0 

0 

0 


0 0 
l+S 2 0 
0 l+5 3 

0 0 
0 0 
0 0 
0 0 
0 0 


0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

1 + <54 0 0 0 0 

0 10 0 0 

0 0 10 0 

0 0 0 1 0 

0 0 0 0 1 


(6.17) 


In this way, the uncertain helicopter model is described as a continuous-time-invariant 
control plant by the following equation: 



y h = G(s) 


(6.18) 
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Figure 6.5 Structure of the uncertain plant 


Similar to the nominal model, the uncertain helicopter model has 8 inputs, 
14 outputs, and 13 states. This model is found by using the M-file mod_heli. 

The frequency response plot of the uncertain plant singular values, obtained by 
using the transfer function between control actions u s and Euler angles for 30 random 
values of the input uncertainties <5,, i = 1,... ,4, is presented in Figure 6.6. The 
frequency responses of the singular values show the presence of an integrator in the 
helicopter transfer function matrix. 

6,2 fi Synthesis of attitude controller 


MATLAB files used in this section 


File 

Description 

dlp_heli.m 

design_heli 

dmu_heli. 

dfrs_he!l 

dmcs_heli 

Generates the open-loop connection for helicopter 
control system 

U Synthesis of attitude helicopter controller 

Robust stability and robust performance analysis 
Frequency responses of the closed-loop system 

Time responses of the uncertain closed-loop system 


The helicopter control system is designed at two levels taking into account that 
the dynamics of the helicopter translational motion is slower than the dynamics of its 
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Frequency responses in respect to control actions 



Frequency (rad/s) 

Figure 6.6 Plant singular values 


angular motion, see for instance [144], First, an integral three channel fi controller 
is designed to ensure robust stability and robust performance of the angular motion. 
This controller ensures small deviations of the Euler angles from their trim values in 
the presence of wind disturbances and plant uncertainty. Then, a simplified positional 
controller is designed which consists of three proportional-derivative (PD) regulators 
in the position and altitude channels. Thus, the helicopter control is decomposed in 
two loops: a fast loop for attitude control and a relatively slow loop for translational 
motion control. 

6.2.1 Performance requirements 

The block diagram of the closed-loop system for attitude helicopter control that 
includes the uncertain helicopter model, the feedback, and the controller, as well 
as the elements which reflect the performance requirements, is shown in Figure 6.7. 
The aim of this control is to keep the attitude angles </>, 0, f close to their reference 
values <p re f, &ief, V^ref in the presence of input disturbances dist and model uncertain¬ 
ties . The design diagram includes a reference model M, which is used to set the desired 
helicopter response. The helicopter control is done by using a feedback from the Euler 
angles <p, 0, f and from the angular rates p, q, r. It is supposed that the information 
about the measurement variables is obtained from an onboard INS equipped with a 
Kalman filter to improve the accuracy. As mentioned in the beginning of this chapter, 
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pa 


S- 


-Eh 


-H- 


Figure 6 .7 Block diagram of the closed-loop system with performance 
requirements 


it is assumed that the effect of measurement noises on the control system is negli¬ 
gible in comparison to the effect of wind disturbances which is confirmed by the 
simulations done latter on. That is why the noise suppression is not considered as a 
performance requirement in the given case. 

The transfer function matrix Gh e ii represents the nominal helicopter model. The 
matrix 


<5i 0 0 0 

0 S 2 0 0 
0 0 S 3 0 
0 0 0 <5 4 


contains the gain bounded uncertainties that represent the input multiplicative model 
uncertainty. 

The controller output 



is the input to the servoactuators. The transfer function matrix 


W seIV0 


wff.Js) 0 0 O' 

0 ^(S) 0 0 

0 0 0 
0 0 0 wf ervo (s) 


contains the transfer functions of the corresponding servoactuators. 

To obtain good performance of the closed-loop system, we shall implement a 
two-degree-of-freedom controller. The control actions are generated according to the 
expression 


u c = [K r K y \\ 


= K r r c +K y y c , 


( 6 . 19 ) 
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where 

r c = [Kf, O re{ , 

is the reference vector, 

y c = [<p, e, if,p, q, rf 

is the output feedback vector, K r is the 4 x 3 prefilter transfer function matrix, and 
K y is the 4 x 6 output feedback transfer function matrix. The control actions should 
be such that the servoactuator outputs do not exceed the values 

<5“f = 0.183 rad, <5™ = 0.096 rad, S”” = 0.096 rad, 5™* = 0.38 rad 
which correspond to the servo saturations. 

The system has two output vector signals (e y and e u ). The block M is the 3x3 
transfer function matrix of the ideal dynamics model that the designed closed-loop 
system should match to. 

The equation for the feedback variables may be represented as 
y c = G u u s + Gq£2 c + G a d. (6.20) 

where G u is the transfer function matrix with respect to the control signals from 
servoactuators, G a is the transfer function matrix with respect to the engine speed 
reference, and G d is the plant transfer function matrix with respect to disturbances. 
(Here and further on, the disturbance vector is denoted for brevity by d .) The matri¬ 
ces G u ,Gn, Gd are obtained from the transfer function matrix G of the uncertain 
helicopter model (6.18). 

Taking into account the structure of the feedback vector y c , one obtains that 
= W c p (y c - M c r c ), 


K = I w p M- 

A simplified block diagram of the closed-loop system with performance require¬ 
ments, utilizing (6.19) and (6.20), is shown in Figure 6.8. The weighted closed-loop 
system outputs e y and e„ satisfy the equation 


W p c (S 0 Gi,W serv 0 K r 

W u S,K r 


- M c ) W p S„Gd w;s 0 g q 
W u SiK y G d W u SiK y G n 


where the matrix S t = (/ — K y G u W seryo )~ l is the input sensitivity transfer function 
matrix, and S 0 = (I — G u W sm . 0 K y f 1 is the output sensitivity transfer function matrix. 

Further on, the rotor-speed reference Q c is considered as constant and its value 
is taken as = 167 rad/s for the helicopter under consideration. 

The performance criterion requires the transfer function matrix from the exoge¬ 
nous input signals r c , d, and £2 C to the output signals e y and e u to be small in the sense 
of || • || oo, for all possible uncertain plant models G. The transfer function matrices W p 
and W u are used to reflect the relative importance of the different frequency ranges 
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Table 6.3 functions to be minimized 


Function 

Description 

Wp (So G u W servo K r — M c ) 

WpS 0 Gd 

W r p S 0 Ga 

W u S t K r 

WuSiKyGd 

W„S,K y G n 

Weighted difference between the real and the ideal 
closed-loop system 

Weighted sensitivity to disturbance 

Weighted sensitivity to rotor-speed reference 
Weighted control action due to angle references 
Weighted control action due to disturbance 

Weighted control action due to rotor-speed reference 


for which the performance requirements should be fulfilled. The six transfer function 
matrices which constitute the transfer function matrix between the inputs and outputs 
of the extended system are described in Table 6.3. 

The design problem for the attitude helicopter control is to find a linear controller 
K(s) in the reference and the measurable output 

K = \K r K y ] 

that has to ensure the following properties of the closed-loop system: 

Robust stability: The closed-loop system achieves robust stability if this system is 
internally stable for all possible plant models G. 

Robust performance: The closed-loop system should remain internally stable for all 
G and in addition the performance criterion 

r W‘ p (S 0 G u W sen , 0 K r — M c ) w;s 0 G d w;s„G a 111 
L WJStKr wfs t K y G d wfskKyGa JL (6 ' 22) 


should be satisfied for each G. 
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Figure 6.9 Block diagram of p synthesis 


6.2.2 Controller design 

The closed-loop system block diagram associated with the p synthesis problem is 
shown in Figure 6.9. The matrix P is the transfer function matrix of the extended 
open-loop system that consists of the uncertain plant model plus the servoactua- 
tors, the matching model, and the performance weighting functions. It has 11 inputs 
( r c , d, Q c , u c ) and 13 outputs (e y , e u , f, 6, f-, P, d, r )- 

The control actions to the plant are realized by a Digital Signal Controller in real 
time with sampling frequency f = 100 Hz so that the p synthesis is implemented to 
design a discrete-time controller at this sampling frequency. For this aim, the transfer 
function matrix of the nominal open-loop system is discretized for the same frequency 
assuming that there are zero-order holds at the plant inputs. 

Let N d (z) be the transfer function matrix of the discretized nominal open-loop 
system, and denote by P d (z) = F v (N d , A) the transfer function matrix of the uncertain 
open-loop system. Let the block structure A Pd is defined as 



The first block of the matrix A Pd corresponds to the 4 x 4 input multiplicative uncer¬ 
tainty, included in the helicopter model. The second block A F is a 7 x 7 fictitious 
uncertainty block, used to include the performance requirements into the framework 
of the p approach. The inputs of this block are the weighted error signals e y and e„, 
and the outputs are the exogenous signals r c , d, and £2 C . 

The aim of the p synthesis is to find a discrete-time stabilizing controller K d , 
such that for each frequency co e [0, n/T s ], where T s = 2 j x/f, the structured singular 
value p satisfies the condition 


PA Pd [F L (N d ,K d )(jco)\ < 1, 


where F L (N d ,K d ) is the transfer function matrix of the discrete-time closed-loop 
system. The fulfillment of this condition guarantees robust performance of the closed- 
loop system, i.e., 
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for all uncertainties A Pd with || A Pd < 1. Due to the usage of a discrete-time model 
of the open-loop system, the stability of the closed-loop system with the controller 
K d is guaranteed. 

The transfer function matrix M of the ideal matching model is chosen as diagonal 
in order to suppress the interaction between the three channels and is taken as 


M(s) = 


V>n\ 

0 

0 


0 

0 


0 

0 


where 


1 

0.40V + 2 x 0.40 x 0.7s + 1 ’ 
1 

0.35V + 2 x 0.35 x 0.7s + 1 ’ 


0.25V + 2 x 0.25 x 0.7s + 1' 


The model transfer functions corresponds to desired closed-loop bandwidths of the 
roll, pitch and yaw channels equal to 2.5,2.86, and 4.0 rad/s, respectively. 

The n synthesis is done for several performance weighting functions that ensure 
a good balance between system performance and robustness. On the basis of the 
experimental results, we choose the performance weighting function 

10-s+l 
10“ 2 s + 1 
0 5 . 0 ^ 


W p (s) = 


0 


0 

10 -3 s + 1 
s + 1 

0 


0 


10.0 


0 

10 -3 s + 1 


and the control weighting function 


W u (s) = 


r 0.02s + 1 
10“ 4 s+ 1 
0 

0 


0 

0.02s + 1 
10“ 4 s + 1 
0 


0 0 


0 0 


0 

0.02s + 1 
10“ 4 s + 1 
0 


0 

0 

0.02s + 1 
10~ 4 s + 1 . 


The performance weighting functions are chosen as low-pass filters to suppress the 
difference between the system and model for frequencies up to 20 rad/s (Figure 6.10). 
The control weighting functions are chosen as high-pass filters to impose constraints 
on the control action components with frequencies above 10 rad/s (Figure 6.11). 

The transfer function matrices G(s), M(s), W p (s), and W u (s) are converted to 
discrete-time form when finding the discretized model N d (z). 



Magnitude (dB) ^ Magnitude (dB) 
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Inverses of performance weighting functions 



’ure 6.10 


Magnitude responses ofperformance weighting functions 


Inverses of control weighting functions 



Figure 6.11 Magnitude responses of control weighting functions 
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Table 6.4 Results of the /i synthesis 


Iteration 

Controller order 

Maximum value of ft 

1 

37 

1.089 

2 

47 

0.993 

3 

41 

0.993 

4 

41 

0.991 



The open-loop interconnection used in the design is done by the file dlp_he 1 i. 
The ti synthesis is performed by using the M-file design_heli which implements 
the MATLAB function dksyn. The results from the D-K iterations are shown in 
Table 6.4. The best controller is obtained after the fourth iteration and is of 41st order. 
(In the given case, the function dksyn stops automatically after the fourth iteration.) 
It should be pointed out that controllers of such order are typical for the fi synthe¬ 
sis method and result from the necessity to satisfy simultaneously the performance 
and robustness requirements. The usual practice is to decrease the controller order 
implementing some method for order reduction. In the given case, it is possible to 
reduce the controller order to 30 without sacrificing the closed-loop performance and 
robustness. This is done by the command line 
Kd_30 = reduce(Kd,30) 

Further on, we use the 30th-order controller in the investigation of the closed-loop 
system properties. 

6.2.3 Frequency responses 

The block diagram of the discrete-time system, used in the closed-loop analysis, is 
shown in Figure 6.12. Note that the transfer function matrices with superscript D are 
discrete-time counterparts of the transfer function matrices of the continuous-time 
system model. In the analysis, we take into account the effect of measurement noise 

6 = [v<t>, Vo, Vf, Vp, Vq, Vrf 

in the angles and angular rates which was neglected in the design. 
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Robust stability 



Frequency (rad/s) 

Figure 6.13 Robust stability of the closed-loop system 


Consider first the robustness properties of the closed-loop discrete-time sys¬ 
tem determined by the M-file dmu_heli. In Figure 6.13, we show the frequency 
response of the structured singular value Ma F L (Nd,K d ) corresponding to the robust 
stability analysis of the closed-loop system. Since the maximum value of p over 
the frequency is 0.3223, the uncertain system can tolerate up to 310 percent of the 
modeled uncertainty, i.e., the robust stability margin of the closed-loop system is 
310 percent. 

The frequency response of the structured singular value corresponding to the 
robust performance analysis is shown in Figure 6.14. The closed-loop system achieves 
robust performance for all uncertain plant models and disturbances. 

The frequency responses of the discrete-time closed-loop system are obtained 
using the M-file df rs_heli. 

The singular value frequency response plots of the 30th-order p controller are 
shown in Figure 6.15. Since the controller has nine inputs and four outputs, its behavior 
in the frequency domain is represented by the responses of four singular values. 

The frequency responses of the singular values of the closed-loop transfer func¬ 
tion matrix for 30 random values of the plant uncertainty are shown in Figure 6.16. It 
is seen that the closed-loop system frequency responses are close to these of the model 
M for frequencies up to 10 rad/s which is a result of achieving robust performance. 
The closed-loop bandwidths of the roll, pitch, and yaw channels are equal to 2.3,2.8, 
and 3.9 rad/s, respectively, which are close to the corresponding values prescribed 
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Robust performance 



Frequency (rad/s) 

Figure 6.14 Robust performance of the closed-loop system 


Singular value plot of the controller 



Frequency (rad/s) 


Figure 6.15 Frequency responses of the /x controller 
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Closed-loop singular value plot 



Frequency (rad/s) 

Figure 6.16 Frequency responses of the closed-loop system and model M 


by the model. The frequency response plot of the singular values of disturbance-to- 
output transfer function matrix is shown in Figure 6.17. It is seen from the figure that 
the disturbance attenuation at low frequencies is more than 300 times (50 dB). This 
guarantees good response of the closed-loop system in the presence of significant 
wind disturbances. 

As it is seen from Figures 6.18 and 6.19, the measurement noises have weak 
effect on the output and control of closed-loop system. For this reason, the noise 
suppression was not included in the performance requirements during the controller 
design. 

The worst case loop-at-a-time gain and phase margins of the uncertain closed-loop 
system are determined by using the Robust Control Toolbox™ function wcmargin 
eliminating the reference channel of the controller. This function computes the disk 
margins at the input and output such that for all gain and phase variations inside the 
disk the nominal closed-loop system remains stable. From the worst case bounds at 
the output, we obtain for roll, pitch, and yaw channels the following results: 

phi_loop_margin = 

GairiMargin: [0.1210 8.2662] 

PhaseMargin: [-76.2044 76.2044] 
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Frequency: 5.6285 

WCUnc: [lxl struct] 
Sensitivity: [lxl struct] 


theta_loop_margin = 

GainMargin: [0.1129 8.8548] 
PhaseMargin: [-77.1134 77.1134] 
Frequency: 8.7824 

WCUnc: [lxl struct] 
Sensitivity: [lxl struct] 


psi_loop_margin = 


GainMargin: [0.0777 12.8780] 
PhaseMargin: [-81.1196 81.1196] 
Frequency: 6.2048 

WCUnc: [lxl struct] 
Sensitivity: [lxl struct] 


Clearly, the largest gain and phase margins have the yaw channel. 



Frequency (rad/s) 


Figure 6.17 Output sensitivity to disturbances 
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Output sensitivity to noises 



Frequency (rad/s) 


Figure 6.18 Output sensitivity to measurement noises 


Control sensitivity to noises 



Frequency (rad/s) 

Figure 6.19 Sensitivity of control action to measurement noises 
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Response in <j> 



Time (s) 


Figure 6.20 Response in roll angle <p 


6.2.4 Transient responses of the linear system 

Consider now the transient responses of the uncertain closed-loop system due to step 
reference inputs. The following reference amplitudes are chosen: 

(j) re f =10 deg, 0 re f = —10 deg, Vto =15 deg 

The step responses of the sampled-data closed-loop system, obtained by 
the M-file dmcs_heli for 30 random values of the uncertainty, are shown in 
Figures 6.20-6.22. Clearly, the closed-loop system is not too sensitive to the uncer¬ 
tainty. The responses have small overshoots and the steady-state errors are less than 
0.9 deg which is acceptable in practice. Smaller steady-state errors may be obtained 
if the uncertainty level assumed in the design is smaller. Note that the angles 0, 
iff, shown in the figures, are not the corresponding full angles characterizing the 
nonlinear plant but represent the deviations of these angles from their respective trim 
values. 

6.2.5 Position controller design 

Once the attitude motion of the helicopter is stabilized, it is possible to translate the 
helicopter to the desired point of space by using three simple PD regulators which 
produce the necessary control actions. To design such regulators, we shall implement a 
technique similar to the one, presented in [145] and based on approximate description 
of the helicopter translational motion. 




ip (deg) 0(deg) 
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Response in 6 



Time (s) 


Figure 6.21 Response in pitch angle 9 


Response in ip 



Time (s) 


Figure 6.22 Response in yaw angle f 
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Assuming that the angles 0 and 9 are small (i.e., sin 0 ~ 0, sin 0 ~ 9), and the 
products uq and vp are negligible, (6.7) may be represented approximately as 

V x = w(cos 0 cos 0)0, 

V y = —w(cos0)0, (6.23) 

V z = w cos 0 cos 6, 
where, according to (6.2), 

w = Z/m + gcos<f>cos9. (6.24) 

Neglecting the fuselage and vertical fin forces along the Z axis in comparison to the 
main rotor thrust we have that 

^ » -T m , 

which, along with (6.24), shows that the desired altitude may be reached by appropriate 
change of the collective pitch angle <5 co i. Similarly, the desired positions x and >’ in the 
horizontal plane may be reached by appropriate deviations of the pitch and roll angles 
9 and 0, respectively. Equation (6.23) suggests to input the following PD regulator 
actions to the servoactuators: 

K pl (z lef -z)-K dl V z 
cos 0 cos 9 

u x = (6 

COS 0 COS 0 

Kp 3 (y K{ -y)-K d3 V y 

y COS 0 

where x re f,y re f,z ref are the coordinates of the desired position in the 3D space, 
Kp i, Kp 2 , Kp 3 are the proportional, and K d \ , K d2 , K d3 —derivative coefficients of the 
PD regulators chosen so as to ensure the desired dynamics of the helicopter motion to 
the prescribed position. The control laws (6.25) allow to decouple approximately the 
translational motion of the helicopter from its angular motion and to control separately 
the motions along X, 7, and Z axes. 

The control actions u z , u x , u v that ensure the desired position are added to the 
corresponding outputs of the p controller that stabilizes the attitude motion as shown 
in Figure 6.23. The position controller K pos implements the PD regulators (6.25). In 
the given case, the following regulator coefficients were found appropriate (to three 
significant digits): 

K p i = -0.531, K p2 = -0.0695, K p3 = 0.0225, 

K dl = -0.0327, K dl = -0.102, K d3 = 0.0355. 

These coefficients are found by optimization procedure to provide the desired form 
of the transient responses and small settling time. Their signs are chosen so as to 
ensure the stability of the corresponding control loops. 
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Figure 6.23 Helicopter controller structure 


6.3 Hardware-in-the-loop simulation 


MATLAB files used in this section 


File 

Description 

sim_heli_double.six 

Simulink model of the nonlinear system 
in double precision 

sim_heli_single.six 

Simulink model of the nonlinear system 
implementing single precision controller 

sim_HlL_SCl_heli.m 

HIL simulation of the helicopter control 
system and visualization of the results 

HIL_SCI_heli.six 

Simulink model of the extended helicopter 
dynamics in double precision executed on 
the host PC 

HIL_SCI_target_heli.six 

Simulink model of the single precision 
helicopter controller embedded in DSC 
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6.3.1 Nonlinear system simulation 

The transient responses of the nonlinear closed-loop system with discrete-time u 
controller are obtained by the Simulink model sim_heli_double using the 
double-precision arithmetic of MATLAB . The control actions produced by the lin¬ 
ear controller are added to the trim values of the control actions determined for 
hovering. To avoid the using of variable step in the integration of the helicopter 
differential equations, the nonlinear helicopter dynamics is discretized for the sam¬ 
pling interval T s = 0.01 s. This is done by implementing the Bogacki and Shampine 
method for solving ODE as described in Chapter 2. The helicopter model is real¬ 
ized with MATLAB Embedded Function blocks which allows to compile in C the 
MATLAB functions included in the Simulink model. This increases significantly the 
speed of the simulation process. 

The wind simulation in the nonlinear model is done using the low-altitude Dry den 
Wind Turbulence Model as specified, for instance, in [146-149]. The wind model is 
realized using band-limited white noise with appropriate digital system difference 
equations. 

According to the Dryden model, turbulence is a stochastic process defined by 
velocity spectra. The power spectral densities for the wind velocities along X, Y, and 
Z axes are given by the following equations: 

_ 2 2 Lu 1 

CT “ nV 1 + (L u Q.f ’ 

_ 2 L v 1 + 3(L„£2) 2 
CTy nV (1 + (L V Q,) 2 ) 2 ’ 

_ 2 L w 1+3 {L w Q.f 
ffw ^v(i + (L w n) 2 ) 2 ’ 

where o u ,o v ,o w are the corresponding turbulence intensities, L u , L v , L w are the gust 
length scales, and £2 is the spatial frequency. The vertical length scale and turbulence 
intensity can be assumed to be L w m \z\ and a w = 0.1 w 20 . Here, vv 20 is the given wind 
speed in knots (1 knot = 0.514444444 m/s) at 20-flt (6-m) altitude. The gust length 
scales can be found from the following equations: 

L w = h 
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and the turbulence intensities are computed from 
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For light turbulence, the wind speed at 20 ft is 15 kn; for moderate turbulence, the 
wind speed is 30 kn, and for severe turbulence, the wind speed is 45 kn. Further on 
in the simulations we make use of the value w 2 o = 30 kn, corresponding to moderate 
turbulence. 

For a vehicle flying at a speed V through a frozen turbulence field with a spatial 
frequency of Q (rad/m), the relationship between Q and the circular frequency co 
(rad/s) is given by w = QV. This allows to derive difference equations for the wind 
velocities (in ft/s) in the form 


<wind(* + 1) = ( 
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where rj u , rj v , r] w are band limited white noises with unit variances. 

The wind velocities are computed by the M-file wind_model. The noises 
rju, rj v , r] w are generated by the Simulink Band-Limited White Noise block. Since 
the wind velocity is a vector in the Earth fixed inertial frame, the computed wind 
velocities are transformed into body coordinates using the direction cosine matrix. 

The nonlinear system simulation involves also simulation of the measurement 
errors which were neglected during the controller design. The modeling of these errors 
is done under the assumption that the measured Euler angles 6, f and angular rates 
p, q, r are obtained by an INS performing Kalman filtering. This means that the errors 
in the measured variables may be considered as white noises which can be modeled 
by using the Simulink Band-Limited White Noise block. It is assumed that the angles 
can be measured to an accuracy of 1 deg and the rates to an accuracy of 0.1 deg/s. 

The Simulink model sim_heli_single allows to compute the transient 
responses assuming that the controller works using single precision arithmetic. Sim¬ 
ulation results for the nonlinear system are presented in the next section along with 
the results form hardware-in-the-loop simulation (HIL) simulation of the closed-loop 
system. 

6.3.2 HIL simulation setup 

The hardware platform for FIIL simulation of helicopter control system consists of a 
host computer (PC) and eZdsp™ F28335 starter kit equipped with the Texas Instru¬ 
ments TMS320F28335 Digital Signal Controller (DSC) (the same as the one used for 
HIL simulation in Chapter 4). The DSC works at 150 MHz and may perform sin¬ 
gle precision (32-bit) computations by using FPU (Floating-Point Unit). The control 
algorithm is embedded and runs with frequency 100 Hz on the target DSC. RS-232 
interface is used for communication between the host PC and target DSC the interface 
being configured at 115,200 bps. The serial communication imports from 20 to 30 ms 
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Figure 6.24 HIL simulation of helicopter control system 


delay, while the DSC target and host PC compute their output signals much faster. 
That is why the simulation of the closed-loop system cannot be done in real-time, 
and it is necessary to use a protocol mode for serial communication. According to 
the protocol used in Embedded Coder®, a software handshaking between the host and 
target is implemented. The transmitting side sends “SEND message” indicating that it 
is ready to transmit. The receiving side sends back “READY message” indicating that 
it is ready to receive. The transmitting side then sends data and when the transmission 
is completed it sends a checksum. DSC transmits a frame of data (the control signals) 
consisting of 10 B to host PC. Once host PC receives data from DSC, it feedbacks a 
frame of data (the sensor signals) consisting of 26 B. In this way, the controller works 
exactly as in real-time independently on the presence of communication delays. 

The block diagram which represents the hardware-in-the-loop simulation of the 
closed-loop helicopter control system is shown in Figure 6.24. For more realistic 
results, the helicopter model is simulated in double-precision floating-point arith¬ 
metic, the processor work is simulated in single-precision arithmetic and the signals 
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from INS and to servoactuators are assumed to be 32-b single precision numbers. To 
reduce the communication load between the host computer and target processor, the 
reference trajectory is computed online inside the embedded controller. 

Thus, three simulation models of the helicopter control system are used, namely, 

Model 1 The Simulink model sim_heli_double using only double-precision 
arithmetic in all computations, 

Model 2 The Simulink model sim_heli_single implementing single-precision 
arithmetic to simulate the DSC computations, sensor, and servoactuator signals, 

Model 3 The Simulink models HIL_SCI_heli implementing double-precision 
arithmetic to simulate helicopter model on PC and HIL_SCI_target_heli 
using single-precision arithmetic to compute control actions on the target DSC. 
Models 1 and 2 are implemented only on the host PC, while Model 3 is implemented 
on PC and on DSC. The host PC and the DSC perform computations with the same 
sampling frequency, equal to 100 Hz, as assumed in the controller design. All models 
use fixed step integration of the system difference equations. In what follows we 
compare the results obtained by Models 1 and 3 in order to assess the effect of using 
single-precision computations on DSC and in the sensor and actuator signals. Model 2 
is used to validate the automatically generated control code, and the results from using 
this model are very close to the results from HIL simulation. The simulation results 
are saved on the PC and are visualized in MATLAB. 

6.3.3 Results of HIL simulation 

The HIL simulation of helicopter control system is done for different desired trajec¬ 
tories in the 3D space including hovering, motion to a desired point of the space, 
and circular motion at given altitude. The simulation is performed on the full nonlin¬ 
ear model of closed-loop system, including the extended helicopter dynamics, inner 
loop attitude control, and outer loop position control in the presence of wind dis¬ 
turbances and measurement noises. The variations in position obtained are result of 
vehicle dynamics, wind disturbances, sensor noises and floating point errors. In this 
subsection, we present the results for circular motion in the 3D space. 

The desired trajectory is set as a circular path of diameter 100 m in the horizontal 
plane, 

x(t) = A sin(27r/f), y(t) = A s\n(2nft + tt/ 2), 
with A = 50 m,/ = 0.02 Hz along with a motion in the vertical plane described by 
z(f) = —2tm if t < 10 s 
—20m if t > 10s. 

The initial conditions are chosen as 

x(0) = 0 m, y(0) = 50 m, z(0) = 0 m 

and the flight time is set equal to 100 s. During this time, the helicopter is performing 
two circles with average velocity greater than 6 m/s. 
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Figure 6.25 Wind velocities 


The wind velocity components acting on the helicopter during the flight are shown 
in Figure 6.25. 

The corresponding transient responses along the X, Y, Z axes are shown in 
Figure 6.26. Independently on the wind disturbances acting on the helicopter, the 
motion on the desired path is performed with sufficient accuracy. 

The transient responses in the Euler angles and in the lateral flapping angle 
are shown in Figures 6.27-6.30. Significant initial deviation in the pitch angle 0 
occurs, caused by the aggressive input <S| on to adjust to desired trajectory the initial 
vehicle motion. There are also some periodical deviations of the Euler angles due to 
the necessity to ensure the appropriate velocities along the corresponding axes. The 
deviations of 0, 9, and f from their trim values during the translational motion change 
the linearized plant model, but due to the large robust stability margin (310 percent), 
this change does not affect significantly the helicopter motion. 

The control actions that ensure the necessary translations along the X, Y, Z axes 
are shown in Figures 6.31-6.34. These actions are less than their corresponding 
maximum allowed values and have some small offsets due to the nonzero mean 
values of wind disturbances. 

To access the simulation accuracy, we computed the mean values and the standard 
deviations of the differences between the variables, determined by hardware-in-the- 
loop simulation and the corresponding variables, evaluated by using double-precision 
arithmetic. The results for the circular motion under consideration are shown in 
Table 6.5 where the superscripts M, and M 3 denote the variables computed by using 
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Figure 6.27 Response in 0 during circular motion 
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Figure 6.29 Response in f during position change 
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Figure 6.30 Response in lateral flapping angle b\ during position change 
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Figure 6.31 Collective pitch angle during position change 
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Figure 6.32 Longitudinal cyclic pitch angle during position change 
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Figure 6.33 Lateral cyclic pitch angle during position change 
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Figure 6.34 Tail rotor pitch angle during position change 


Table 6.5 Simulation errors 


Quantity 

Mean value 

Standard deviation 

Unit 


6.81 x 10~ 3 

5.79 x 10“ 2 

m 

yM, _ y M 1 

1.36 x 10 -2 

6.08 x 10“ 2 

m 


-8.93 x 10" 3 

2.15 x 10~ 2 

m 

0^3 _ 

-1.04 x 10“' 

3.11 x 10 -1 

deg 

6^ _ QMl 

7.92 x 10~ 2 

3.37 x 10- 1 

deg 

f M 3 _ 0.M, 

-3.11 x 10- 3 

5.33 x 10- 2 

deg 

cfh _ qMi 

3.56 x 10~ 8 

1.56 x 10- 1 

deg 

bf-k 

-5.62 x 10“ 4 

1.09 x 10 -1 

deg 

C-C 

-2.44 x 10" 2 

5.63 x 10- 1 

deg 

c - c 

1.90 x 10- 3 

6.34 x 10~ 2 

deg 

€ - € 

5.74 x 10" 5 

4.16 x 10~ 2 

deg 

C - C 

9.31 x 10~ 2 

4.19 x 10 -1 

deg 
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Models 1 and 3, respectively. The two models produce results that are sufficiently 
close which means that the algorithm embedded in the DSC produces control actions 
that are close to the predicted by the // synthesis actions. 

As noted earlier, the n controller designed is valid for hovering. According to 
the experiments, it may be used also to change the helicopter position in sufficiently 
large area. 

The results obtained in this chapter show that it is possible to apply successfully 
high order robust helicopter controllers by using Digital Signal Processors. The imple¬ 
mentation of ix controllers allows to achieve robust stability and robust performance 
of the linearized closed-loop system which is difficult to achieve with other type of 
controllers. The n controller allows to improve the system performance especially in 
the case of sufficiently large parameter variations and strong disturbances. 

6.4 Notes and references 

Dynamics models, suitable for control design and simulation of small-scale unmanned 
helicopters, are derived in many sources, see for instance Castillo, Lozano, and 
Dzul [150]; Castillo-Effen et al. [151]; Mettler [143]; Nonami et al. [152]; Raptis 
and Valavanis [153]; and Sandino, Bejar, and Ollero [154], These models are based 
on the first-principles dynamics models developed for full-scale helicopters (see Pad- 
field [141] and Bramwell, Done, and Balmford [155]) accounting for the particular 
characteristics of miniature helicopters. 

The robust helicopter control is based usually on 0 optimization or /i synthesis, 
see Castillo-Effen et al. [151,156], loop shaping is applied to the hover control 
of Yamaha R-50 helicopter and validated in real flight as described in La Civita 
et al. [157], The same approach is used in Boukhnifer, Chaibet, and Larouci [158] to 
control a 3-DOF miniature helicopter and in Postlethwaite et al. [159] and Kureemun 
et al. [ 160] for robust control of the longitudinal and lateral dynamics of the full-scale 
Bell 412 helicopter. In Cai et al. [161], a state-feedback control law combined 
with reduced-order observer is designed and successfully implemented to control 
a small-scale unmanned helicopter. Successful implementation of the n synthesis 
in case of Yamaha R-50 helicopter is reported in Shim [162, pp. 126-137], and a 
similar design is described in Yuan and Katupitiya [163], In both cases, the linearized 
helicopter model developed by Mettler [143] is used and an input multiplicative 
uncertainty of 10 percent is assumed in the helicopter model. The controller designed 
in Yuan and Katupitiya [163] is of 28th order. 

If the helicopter velocity undergoes large variations, it might be impossible to 
achieve high performance and even closed-loop stability over the entire operating 
range with a single linear time-invariant controller. In this case, it is appropriate 
to apply the technique of gain scheduling, see Leith and Leithead [164], which is 
successfully used in the control of uncertain or time-varying systems. This technique 
involves implementation of a family of controllers designed for different regions of 
the parameter space so that to guarantee stability and performance in that region. 
During the system operation, the controllers are changed according to a physical 
parameter measured in real time which detects in what region the system is working 
in the corresponding moment of the time. 




Chapter 7 

Case study 3: robust control of two-wheeled robot 


The design of two-wheeled robot control system represents a challenge to the designer. 
The robot motion in horizontal and vertical planes is described by a nonlinear model 
whose derivation may be a difficult task. The linearization of this model leads to 
unstable nonminimum phase plant which should be stabilized in the presence of 
parameter variations, noises, and disturbances. 

This case study presents the design and experimental evaluation of two con¬ 
trollers for vertical stabilization of two-wheeled robot. The first one is a conventional 
linear quadratic Gaussian (LQG) controller with 17th-order Kalman filter used for 
state estimation. This controller ensures robust stability of the closed-loop system and 
good nominal performance. The second one is a fi controller ensuring both robust 
stability and robust performance. Due to the lack of accurate analytical robot model, 
the controllers design is based on models derived by closed-loop identification from 
experimental data. The robot uncertainty is approximated by an input multiplica¬ 
tive uncertainty which leads to a /r controller of order 44, subsequently reduced to 
30. The yaw motion is controlled by using a proportional-integral (PI) controller on 
the basis of yaw angle estimate obtained by a separate second order Kalman fil¬ 
ter. A software in MATLAB®/Simulink® environment is developed for generation of 
control code which is embedded in the Texas Instruments Digital Signal Controller 
TMS320F28335. Results from the simulation of the closed-loop system as well as 
experimental results obtained during the real-time implementation of the designed 
controllers are given. The theoretical investigation and experimental results confirm 
that the closed-loop system achieves robustness in respect to the uncertainties related 
to the identified robot model. 

The chapter is organized as follows. In Section 7.1, we give a brief description 
of experimental two-wheeled robot. The derivation of robot model using closed-loop 
identification procedures is considered in Section 7.2. On the basis of model obtained, 
in Section 7.3, we derive an uncertain plant descriptions with input multiplicative 
uncertainty representation. The robot nominal model is used in 7.4 to design a LQG 
controller involving linear quadratic regulator with 17th-order Kalman filter. The 
uncertain robot model is used in Section 7.4 to design /i controller which ensures 
robust stability and robust performance of the corresponding closed-loop systems. 
A comparison of the two controllers in the frequency domain is done in Section 7.6. 
Results from the experimental evaluation of the two controllers are presented in 
Section 7.7. 

The presentation in this chapter is based on the paper [165], 
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7.1 Robot description 


The general view of the two-wheeled robot in self-balancing mode is shown in 
Figure 7.1. The robot is statically unstable, and its balancing is achieved by rotat¬ 
ing the wheels in appropriate direction. It is assumed that the robot moves on a flat 
surface. 

A schematic diagram of the robot motion is presented in Figure 7.2. The robot 
motion in the vertical plane is described by the tilt angle (/>, while the motion in the 
horizontal plane is characterized by the wheels average angle 6 = (9 L + Of)/2 where 



Figure 7.1 Two-wheeled robot 



Figure 7.2 Robot motion in vertical and horizontal planes 
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Q l and Or are the left and right wheel angles, respectively. The motion around the 
vertical axis is described by the yaw angle f. 

The robot is constructed from four vertically connected plastic platforms. At the 
bottom platforms are situated with two 12-V DC brushed drive motors, together with 
29:1 gearboxes, wheels, and magnetic quadrature encoders for measuring the wheels 
angles. Motors are controlled by power amplifier qik2s!2v!0 receiving commands 
from the digital signal controller (DSC). The next platform hosts the Spectrum Dig¬ 
ital eZdspTMF28335 development board , which supports Texas Instruments DSC 
TMS320F28335. The robot controller and the data acquisition (DAQ) system are 
embedded in the DSC. Stabilization is achieved by using inertial measurement unit 
ADIS16405 containing three orthogonal axes microelectromechanical gyroscopes. 
This unit is mounted on the third platform. The robot is powered by three cell lithium- 
polymer LiPo 12-V battery situated on the uppermost platform. The input signals to 
the motors are pulse width modulated (PWM) duty cycles and direction commands 
sent over RS232 link to the power amplifier forming PWM voltage waveforms for the 
motors. The signals which are measured in real time are wheels angular rates (Ql, Or), 
body tilt rate (</)), and body yaw rate (i//). Real-time DAQ system is organized around 
wireless communication channel based on Bluetooth module. 

The mutual disposition of robot and gyro axes is shown in Figure 7.3. <j) g , xjr g 
denote the tilt angle and yaw angle, measured in the gyro sensors axes. It follows 
from the figure that </> = —<p g and ^ 

The block diagram of the two-wheeled robot control system is shown in 
Figure 7.4. The computation of control actions Ul, Ur to the DC drive motors is 
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Figure 7.4 Block diagram of robot control system 


realized in single precision on the basis of signals from the gyro sensor measuring 
the angular rate <p (and, after integration, the tilt angle f) and signals measuring 
the wheel rotation angles 0 L and Or. The control of the DC motors is executed by 
PWM signals. Control signals in the case of vertical stabilization are identical for 
both motors. The robot turning around the vertical axis (yaw motion) is realized by 
addition and subtraction of one and the same signal from the control signals to the 
left and right motors. The signal for robot turn is produced by a separate PI regulator 
based on feedback from yaw angle f which is estimated by a second-order Kalman 
filter. This approach is based on the assumption that the dynamics of yaw motion is 
separated from the dynamics of the motion in vertical plane and is validated by the 
experiments. 

The interface between the IMU ADIS16405 and DSC TMS320F28335 is pre¬ 
sented in Appendix E, and the operation of the rotary encoder is described in 
Appendix F. 


7,2 Closed-loop identification of robot model 


MATLAB files used in this section 


File 

Description 

ident_robot.m 

M-file for identification of robot dynamics in 
the vertical plane 

ident_psidot_thetadot. it 

i M-file for identification of robot dynamics 
around the vertical axis 

ident_thetadot_ul.m 

M-file for identification of left wheel 
dynamics 

ident_thetadot_u2.m 

M-file for identification of right wheel 
dynamics 
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Figure 7.5 Representation of robot dynamics 


To determine a mathematical model of the robot, one may apply physical model¬ 
ing or identification. The standard assumptions are ideal rigid body dynamics, flat and 
horizontal ground surface, zero wheel slip, and no friction [166]. Modeling from first 
principles [167-170] has a lot of advantages related to the determination of linearized 
description and easy derivation of uncertain model. However, it requires a profound 
knowledge about physics of the plant and a lot of a priori information. Due to the lack 
of reliable analytical model, in this study, we prefer to use a numerical model obtained 
by identification procedure. An additional reason to use an identification model is that 
such models apart from the robot body dynamics take into account the dynamics of 
sensors, actuators, and motors which facilitates the plant description. Identification 
is performed for small deviations of robot from upright position in order to obtain 
linearized plant model. For this aim, we use the methods described in Appendix D. 

Generally, the motions in the vertical and horizontal planes are connected so that 
the robot plant should be considered as multivariable. However, the experiments show 
that there is a weak interaction between the dynamics of the robot body in the vertical 
plane and the dynamics of the rotation around the vertical axis. The influence of the 
yaw motion on the dynamics in vertical plane may be represented by a relatively slow 
disturbance which can be suppressed efficiently by a robust controller of the vertical 
plane motion. Hence, in order to simplify the robot dynamics, one may assume that 
the motion in vertical plane is independent on the variation of yaw angle which allows 
to approximate the robot plant by two separate single-input-single-output systems. 
This assumption is confirmed by the closed-loop experiments presented in Section 
7.7 and allows to avoid multivariable plant identification and design of higher-order 
multivariable controller. 

The robot dynamics in the vertical plane and the wheel dynamics is represented 
by a single-input-single-output plant as shown in Figure 7.5. The subsystem denoted 
by G^ u corresponds to the dynamics of the vertical plane motion, while the subsystem 
denoted by G ei, reflects the wheels dynamics. Note that although the identification 
problem is simplified in this way, it still may pose difficulties related to the derivation 
of uncertain plant model. 

There are a few reported results about identification of linear discrete-time mod¬ 
els of two-wheeled robots. In [171], the dynamics is described by ARX model of 
fifth order. In [172], identification of third-order state-space model is presented. The 
advantages of the models for control, obtained by means of identification and the lack 
of enough results for such models of two-wheeled robots, motivate the determination 
of uncertain models of such a robot presented in this section. 
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Figure 7. 6 Closed-loop identification setup 


As mentioned previously, two-wheeled robot is inheritably unstable system which 
requires the identification experiment to be done in closed-loop setting. In such 
situation, predictive error method is appropriate if the input-output data are informa¬ 
tive and the true system dynamics is in the model set. Usually, the first requirement is 
guaranteed by adding an external persistently excitation signal to the controller out¬ 
put, and second requirement is guaranteed by firstly estimating the high-order model 
and then reducing model order by appropriate technique. 

Experimental setting intended to identify the plant in Figure 7.5 is shown in 
Figure 7.6. Stabilizing regulator control signal is disturbed by excitation signal which 
is random binary signal (RBS). Excitation signal is output of relay fed with Gaussian 
white noise, generated with MATLAB random generator. The amplitude of RBS is 
chosen to be ±15 percent, so the control signal stays in linear region and the robot 
tilts enough without falling. 

To determine sufficiently accurate models with direct closed-loop identification, 
according to diagram presented in Figure 7.6, it is important the stabilizing controller 
to be “soft.” This means that in case of PI controller, the proportional term should be 
low and the integral term should be sufficient to keep a small error from operating 
point. Stabilizing controller for the two-wheeled robot is composed of two feedback 
loops—one for body tilt angle <p and one for wheels angle 0 = (Oi + Or)/ 2. Transfer 
functions of the controller are chosen as 


W^s) = 


0.002(10y + 1) 2 (35 + 1) 


(7.1) 


A PI controller is used for body tilt angle stabilization. The controller for stabi¬ 
lization of wheels angle is composed of PI part followed by two additional integrators. 
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Figure 7.7 Experimental data for Gj m identification 


Also two real zeros are included to appropriately compensate these integrators in fre¬ 
quency domain to preserve the closed-loop stability. More integrators were included 
to minimize error in wheels angle position. If only standard PI is used, then wheels 
error is increasing steadily. 

Experimental data used in the identification are grouped into two sets. The first 
set is used for model parameter estimation, and the second one is used for model val¬ 
idation. Sample time is T s = 0.005 s and the number of measurements is N = 1,000. 
A test on the degree of persistence of excitation for the input for both data samples 
is done using the function pexcit from System Identification Toolbox™ [173] of 
MATLAB. The degree of persistence of excitation for the first data sample is 999, 
while this for the second data sample is 500. 

In Figures 7.7 and 7.8, we show the experimental data used for the robot model 
identification. 

Relationships from u to 0 and from 0 to 9 are assumed linear. Therefore, different 
types of stochastic polynomial models can be applied. As it follows from Appendix 
D, the most general discrete-time model is 


A(q)y{k) = - »*) + 

F{q) D(q ) 


(7.2) 
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Figure 7.8 Experimental data for Gg^ identification 


where 


A(q) = 1 + Ei a a kd \ B(q) = Yf[ b b k q k+ \ C{q) = 1 + Yfi c k<l *, 

D(q ) = 1 + d kq~ k , F(q) = 1 + Ta fkd~ k 

are polynomials in the delay operator q~ x . Model parameters are a h b n c„ d h f, and 
n a , n/,, n c , n ^,«/ are the polynomial orders. The number of delays is n k . The process 
e(k) is Gaussian white noise with zero mean and strength of 

Further on we make use of the ARX, ARMAX, and BJ models, represented by 
the following equations: 

ARX : A(q)y(k) = B(q)u(k - n k ) + e(k) (7.3) 

ARMAX : A{q)y(k) = B(q)u(k - n k ) + C(q)e(k) (7.4) 

BJ : y{k) = B{q)/F{q)u(k - n k ) + C(q)/D(q)e(k). (7.5) 

Usually, the first estimated model is ARX because of its relative simplicity. In 
addition, it is estimated by the linear least squares method. If the ARX model does 
not pass through validation tests, then ARMAX or BJ models are used. 
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7.2.1 Dynamic models from u to <p 

Estimation of ARX model (7.3) requires knowledge about structure parameters. For 
this aim, a set of 500 ARX models is examined using the function arxstruc from 
System Identification Toolbox. The orders of polynomials A(q) and B{q) vary from 
1 to 10 and the number of delays vary from 1 to 5. Selection of structure parame¬ 
ters is guided by three criteria—model loss function, Akaike information index, and 
Rissanen index (see Appendix D). Based on these criteria, only three ARX mod¬ 
els from the set of 500 are selected for further identification. Their parameters are 
statistically estimated, after that four validation tests are applied: 

1. Autocorrelation and crosscorrelation test of the model residuals, 

2. Test with logarithmic amplitude frequency response of estimated model from 
input signal to model residuals, 

3. Akaike predictive error calculated from model residuals, 


FPE=-ye 2 (k) ]+d/N , 

N \ — d/N 


where d is the number of estimated parameters. 

4. Comparison of model output and measured output by the index 

FIT = 100 x [l - llj) ~?| l2 1 %, 

L \\y-yh\ 

where y is the model output, y is the measured output, and y is the mean ofy. 

In all cases, the experimental data set used for validation is different from that 
used for parameter estimation. Tests 1 and 2 decide whether the model is valid. 
From various valid models, the best model is the model which has smallest FPE and 
largest FIT. 

In our case, the three selected ARX models do not pass test 1 because the autocor¬ 
relation function is crossing the confidence interval for lag 10. Therefore, the selected 
ARX models must be rejected. 

The next step is ARMAX model (7.4) estimation which is done by the func¬ 
tion armax from System Identification Toolbox. Selected structure parameters are 
n a = 1 0, Hf : = 10 ,n c = 10, n b = 3. Figure 7.9 shows zeros and poles of that model 
together with their 99 percent confidence intervals. There is an intersection of some 
zeros confidence intervals with poles confidence intervals which is a motivation 
for model order reduction. Hence, an ARMAX model with structure parameters 
n a = l,n b = 7, n c = 7, n* = 3 is estimated. 

The performance of two estimated ARMAX models are compared in Table 7.1. 
From the two ARMAX models, the model with structure n a = 1 ,n b = l,n c = l,n b = 3 
is chosen based on Tests 1,2,3, and 4. This model is appropriate for controller design. 



386 Design of embedded robust control systems using MATLAB®/Simulintif 


From control 



Figure 7.9 Poles and zeros of ARMAX model with 
n c = 10, nk = 3 

n a = 10, n b = 10, 


Table 7.1 Performance of the subsystem m 

odel from uto<p 


Model 

FIT 

FPE 

ARMAX n a = 10,n* = 10,w c = 10,« t = 3 
ARMAX n a = l,n b = l,n c = 7,n k = 3 

46.36 

49.78 

7.85 

7.57 


Some validation results for the model with n a = 1,n b = 7, n c = 7, n k = 3 are 
given in Figures 7.10 and 7.11. The model passes through the test of autocorrelation 
and crosscorrelation function of model residuals. Therefore, the parameter estimates 
are unbiased, the models of robot dynamics and <j> noise dynamics are adequate. 

In Figure 7.12, we show the logarithmic response of the model between residuals 
and the input signal u. The response is inside the confidence regions which supports 
the claim that the model chosen is adequate. 

ARMAX model, resulting from identification, is assumed as nominal and has 
the form 


<p(z) = G^„ om (z)u(z)+Vj,(z), 


(7.6) 
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Residue correlation 

AutoCorr XCorr (control) 



Figure 7.10 Correlation test of residuals ofARMAX model with n a = 7, n/, = 1, 
n c = 1 ,n k = 3 


Simulated response comparison 



Time (s) 


Figure 7.11 Responses of theARMAX model and the measured data 
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Residue frequency response 
From: Control To: e@Body rate 



Frequency (rad/s) 

Figure 7.12 Logarithmic response of the residuals forARMAX model 


where nom (z) is the nominal transfer function from u to </>, the noise is obtained 
during the identification procedure and reflects the uncertainty in the model found. 
In the given case, we have that 

0.0306z 6 + 0.003992z 5 + 0.01837z 4 + 0.02122z 3 - 
0«,nom(z) - z 2 (z 7 - 0.7768z 6 - 1,502z 5 + 0.8929z 4 + > 

-0.02372z 2 - 0.0435lz - 0.002676 
4 +1.218z 3 - 0.6273z 2 - 0.5815z + 0.3823)' 

The noise v^ is expressed as 

v^(z) = A^(z)n^(z), (7.8) 


where 


z 7 + 0.315z 6 - 1.236z 5 - 0.6616z 4 + 0.4729z 3 + 
z 7 - 0.7768z 6 - 1.502z 5 + 0.8929z 4 + 
+0.3178z 2 - 0.0696z - 0.02562 
^ +1.218z 3 - 0.6273z 2 - 0.5815z + 0.3823 


is shaping filter determined so that rij, is a white noise. 
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Residue correlation 

AutoCorr XCorr (body rate) 



Lag 

Figure 7.13 Correlation test of residuals of BJ model 


7.2.2 Dynamic models from 0 to 6 

In this case, none of the examined ARX or ARMAX models pass through the residuals 
autocorrelation test. Hence, all ARX and ARMAX models were rejected and BJ 
model (7.5) is estimated as being more general. A BJ model with structure parameters 
n h = 3, nj =3 ,n c = 3 ,nj = 3,«* = 1 is estimated using the function bj from System 
Identification Toolbox. 

Results of validation test for this model are represented in Figures 7.13 and 7.14. 
In Figure 7.15, we present the logarithmic response of the model between the 
residuals and body rate f. As it is seen, this response is inside the confidence regions. 
The subsystem from 0 to 0 is described by the following equation: 

<?0) = G^ >nom (z)0(z) + Vg(z), (7.9) 


where 


0.6775z 2 — 0.7007z — 0.1773 
^nom (z) “ z 3 - 1,047z 2 - 0.5094Z + 0.5561 


(7.10) 


is the nominal transfer function and Vg is the noise reflecting the model uncertainty. 
This noise is represented as 


v d (z) = Ng(z)ng(z), 


(7.11) 













Phase (deg) Magnitude (dB) 
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1-Step predicted response comparison 



Time (s) 


Figure 7.14 Responses of the BJ model and the measured data 
Residue frequency response 



Frequency (rad/s) 


Figure 7.15 Logarithmic response of the residuals for BJ model 
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Figure 7.16 Yaw dynamics identification setup 


where the shaping filter 


z 3 - 1.516z 2 + 0.8294z- 0.1448 
~~ z 3 - 2.344z 2 + 2.08lz - 0.7329 

is determined so that ng is a white noise. Note that both transfer functions G^ u nom {z) 
and Ggj, nom (z) are nonminimum phase which is unfavorable in respect to the controller 
design. 

It is necessary to point out that the uncertainty models obtained are not unique. If 
data sets with different measurements are used, then it is possible to obtain models with 
different shaping filters which is due to the properties of the identification methods 
implemented. 

7.2.3 Dynamic model of the yaw motion 

As described previously, the dynamics of the yaw motion is considered as separate 
from the dynamics of the vertical plane motion. Model of robot yaw motion is assessed 
by optimization procedure using the transient response of a tunable parametric model. 
This requires a closed-loop experiment where robot is vertically stabilized and yaw 
motion is initiated. 

Experimental setting is shown in Figure 7.16. 

Vertical and longitudinal stabilization in this experiment is achieved by LQR 
regulator based on estimated ARMAX and BJ models. Control signal is identical for 
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both motors, i.e., u s l = «sr = u s . In addition, a PI regulator controls yaw motion 
based on feedback from f angle, with transfer function 


WJs) = - 


The output of W tc (s) is signal u, which is added to control signal ul for the left motor 
and subtracted from control signal Ur of the right motor. The effect of this is turning 
of the robot around the vertical axis. Thus, for the two control signals, one obtains 


U L = U S - Ui, U R = U S + Wr¬ 
it is assumed that the motion around the vertical axis is described by the linear 
relationship 


Hs) = Gfe L (s)Ge LUL (s)u L (s) + G^ R (s)Gg RUR (s)u R (s). 


First-order models are determined, describing the dynamics between u L and 0 L ; 
between u R and 0 R ; and between 0 L ,0 R , and \jr. The quadratic costs used in the 
optimization are 

1 M 

J 0 LUL = a . / £(^/( 0 - 4 ( 0 ) 2 , 

1 M 

J e RUR = ^ £ (UO - 0r( 0) 2 , (7.12) 


1 M 

J 'i' = _ V" 1 (0) 2 

As a result, the following yaw model transfer functions are found: 


G 0 L u L 0) = 


8.5867 
0.1328s + 1 ’ 


G e R u R (s ) = 


8.7270 
0.1186s + 1 ’ 


2.004 ^ 2.009 

o.oii 9 s+ r ^ 0.0119s+r 


In Figure 7.17, we show the two control signals Wi and u R used in the optimization. 
In Figures 7.18 and 7.19, we compare the measured signals and the model output 
signals. The minimum values of the quadratic costs (7.12) are 


•4^ = 297.877, Jg RUR = 87.184, ^ = 3.896. 

It is seen from the figures that the models obtained describe with sufficient accuracy 
the rotation dynamics around the vertical axis (Figure 7.20). 
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Figure 7.17 Control signals 



Figure 7.18 Left wheel velocity 
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Time (s) 

Figure 7.19 Right wheel velocity 



Figure 7.20 Velocity around vertical axis 
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7.3 Derivation of uncertain models 

MATLAB files used in this section 


File Description 

unc_model_opt. m Finds the more accurate uncertainty model 

{G^ u and are of orders 12 and 10, respectively) 
unc_modelm Finds reduced-order uncertainty model 

(G^ u and Gq^ are of orders 9 and 5, respectively) 
ident_unc. m Determines the nominal model 

and 3-sigma confidence intervals 
of the uncertain model frequency responses 


7.3.1 Signal-based uncertainty representation 

Based on (7.6) and (7.9), the uncertain robot model may be represented as shown in 
Figure 7.21. We will call this model as model with signal-based uncertainty repre¬ 
sentation because the uncertainty is represented by the noise signals. Further on we 
assume that and n$ are white noises with unity variances. The model is obtained 
directly from the identification procedure without additional computations. 

7.3.2 Input multiplicative uncertainty representation 

Condition of unbiased parameter estimates obtained by the identification guarantees 
that the exact parameter values are contained in the confidence intervals of parameter 
estimates with probability close to 1. This allows to derive parametric uncertainty 
model with scalar uncertainties. The number of these uncertainties is equal to the 
number of estimated parameters. In the case of ARMAX model with n a = l,n b = 7, 
n c = 1 ,nt = 3, this number is equal to 21 which makes the implementation of such 
model unpractical. That is why it is preferred to derive input multiplicative uncertainty 
models of the transfer functions G^ u and which contain unstructured (complex) 
uncertainties. Based on parameter confidence intervals, maximum relative devia¬ 
tions from nominal models in the frequency domain are obtained. In order to derive 
models with multiplicative uncertainties, these deviations are approximated, through 



Figure 7.21 Robot model with signal-based uncertainty representation 
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Uncertainty approximation in Gjq/j, „ 



Frequency (rad/s) 


Figure 7.22 Ninth-order approximation of the relative uncertainty in Gi, 


optimization procedure in the M-file unc_model_opt, with shaping filters which 
are represented by transfer function of 12th and 10th order, respectively. However, 
in the design of the /x controller in Section 7.4, we use a reduced-order uncertainty 
model in which the transfer functions G^ u and G^ are of orders 9 and 5, respectively. 
The higher order uncertainty model, implemented by the M-file unc_opt_model, 
is used in the robustness analysis of the LQG and /x controllers. 

The maximum relative uncertainties in Gj, u and in Ggz along with their low 
order approximations are represented in Figures 7.22 and 7.23, respectively. Note 
that the maxima along the frequency of the uncertainties are in the higher frequency 
range. The approximations are used to determine the weighting shaping filters in the 
corresponding input multiplicative uncertainty representations. Resulting uncertain 
models for the two plant subsystems are 

Gj, u (z) = G^ nom (z)(l + W^z) Af), (7.13) 

Gn<z) = G^, nom (z)(l + Wg(z)Ag), (7.14) 

where fV^(z), Wg (z) are the shaping filters and A r/ -, Ag are scalar uncertainties which 
satisfy 


|A*| < l, |A«| < 
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Uncertainty approximation in Gjq/j, jyj, 



Frequency (rad/s) 

Figure 7.23 Fifth-order approximation of the relative uncertainty in G w 


r&0- 

G <pu 


"*■ G^nom 






Figure 7.24 Robot model with input multiplicative uncertainly representation 


The robot model with input multiplicative uncertainty is shown in Figure 7.24. 
The Bode plots of the uncertain models G;^ and Gfy are shown in Figures 7.25 
and 7.26, respectively. 

The model given in Figure 7.24 is used for /a robot controller design described 
in Section 7.5. 
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Bode plot ofG deidt dl j, ldt 



Frequency (rad/s) 

Figure 7.25 Bode plot of G^ u 
Bode plot of G d( p /dl u 



Frequency (rad/s) 


Figure 7.26 Bode plot of Gg# 















Case study 3: robust control of two-wheeled robot 399 


7.4 LQG controller design 


MATLAB files used in this section 

File 

Description 

LQG_kalman_phi.m 
dfrs_LQG 

kalman filter phi.six 
kalman_psi_sim. six 

Design of LQG controller 

Frequency responses of the LQG controller 
Simulation of tilt angle Kalman filter 
Simulation of yaw angle Kalman filter 


Consider first the design of a LQG robot controller using the model with signal- 
based uncertainty representation shown in Figure 7.21. 

The block diagram of the robot control system with LQG regulator is shown in 
Figure 7.27. The system state is estimated by the Kalman filter KF and the control 
action is generated by the linear quadratic regulator LQR. The estimate i// of the yaw 
rate f is obtained by the Kalman filter KF^. The PI controller Pf, is used to ensure 
the desired performance of the yaw dynamics. 

The control actions to the plant are realized by a DSC in real time with sampling 
frequency f = 200 Hz. For this reason, the LQG design is implemented to determine 
a discrete-time controller at this sampling frequency. 



Figure 7.27 Block diagram of the closed-loop system with LQG regulator 





























400 Design of embedded robust control systems using MA TLA Bf/Simulinlf 

In the LQR design, the ARMAX and BJ models of G, Pu nom (z) and nom (z) are 
represented by the following state equations: 

xfk + 1) = V#) + + V*(*)> (7-15) 

m = C^(k) + H^(k), 

x&(k + 1) = A@x@(k) + B®u(k) + J@v & (k), (7.16) 

©(£) = C^x e (k) + H B v e (k) 

where x^, x@ are state vectors with dimensions 9 and 6, respectively, v^, Vg, are 
discrete-time white Gaussian noises with unit variances , and A, p , B^, f,, Q„ Hj,, Aq, 
Bq,Jq,Cq, Hq are constant matrices with corresponding dimensions containing the 
model parameters. The noises v, p , Vg, are obtained during the identification procedure 
and reflect the uncertainty in the model found. These noises are also represented 
as models with input multiplicative uncertainty which are used in the analysis in 
frequency domain. 

The nonmeasurable wheels angle is described by the first-order difference 
equation 

0(k + 1) = 9(k) + T s 6(k), (7.17) 

where T s is the sample time. The following state equations are also included in the 
plant description: 

x^(k+l) = x^(k)-T s <P(k), (7.18) 

xfk + 1) = Xi (k) + Tfrfk) - 0(k)), (7.19) 

where r e is the wheels reference angle. These equations allow to compute approxi¬ 
mations of the discrete-time integrals of <fi and of tracking error r s —0, respectively. 
Both integrals are used in the design of linear-quadratic regulator in order to ensures 
efficient stabilization in the vertical plane and zero steady-state tracking error. In this 
way, one obtains the full plant equations of 18th order in the form 

x(k+ 1) = Ax(k) + Bu(k) + Jv(k), 

(7.20) 

y(k) = Cx(k) + Hv{k), 

where 

x = [xl 4 © X<j>i Xi f, y = [f 0 © v = [v* vef. 

and the matrices A, B, J, C, H are obtained combining (7.15)—(7.19). 

The aim of the controller design is to minimize the quadratic performance index 

J(u) = [x(k) T Qx(k) + u(k) T Ru(k)], (7.21) 

where Q and R are positive definite matrices chosen to ensure acceptable transient 
response of the closed-loop system. 




Case study 3: robust control of two-wheeled robot 401 


As already shown in Chapter 4, the optimal control which minimizes (7.21) in 
respect to the system (7.20) is given by 

= —Kx(k), (7.22) 

where the optimal feedback matrix K is determined by 

K = (R + B t PB)~ 1 B t PA (7.23) 

and the matrix P is the positive definite solution of the discrete-time matrix algebraic 
Riccati equation 

A t PA -P- A t PB(R + B t PB)~ 1 B t PA + Q = 0. (7.24) 

The solution of the Riccati equation (7.24) and determination of the gain matrix K 
(7.23) is done by the function dlqr of MATLAB. 

Let the matrix K is partitioned according to the dimensions ofxj„x®, as 

K = [Kj, K & K & K h K Xi ]. 

Since the state x(k ) of system (7.20) is not accessible, the optimal control (7.22) is 
implemented as 

u(k) = -Kjf-fk) - K & x & (k) - K @ &(k ) - K^(k) ~ K x Mk), (7-25) 
where x^k), x®(k) are estimates of x^k) and x@(k), respectively, and 

%.(£ + 1) = x^(k) - fkk), (7.26) 

m + 1) = Mk) + T s (r @ (k) - @(k)) (7.27) 

are estimates of x^.(k) and x,(k), respectively. The estimates <p(k) and Q(k) are 
obtained by the aid of a Kalman filter. In particular, the quantity <p(k) is obtained 
from 

kk) = m - 4 (k), (7.28) 

where <p(k) is the measured tilt angular rate and <p g (k) is the estimate of the rate 
gyroscope bias. The gyro bias 4 is modeled by the additional equation 

4 (* + 1) = 4 (k) + J g v h (k), (7.29) 

where Vj )g is a white Gaussian noise with unit variance and the coefficient J g is 
determined experimentally as J g = 10 -4 to obtain a good estimate of <p . Combining 
(7.15)—(7.17) and (7.29), the Kalman filter is designed for the 17th-order system: 

x/(k + 1) = A f Xf(k) + Bfu(k) + JfV f (k), 

y f (k) = C f xj(k) + H f v f (k), (7.30) 

where 

x f = \x\ © <fi g ] T ,y f = [00© <k g ] T , v f = [v^ ue u g ] r 



402 Design of embedded robust control systems using MATLAB® /Simulink® 


and Af, B f , J f , Cf, H f are matrices of corresponding dimensions. 

The discrete-time Kalman filter for the system (7.30) is obtained as 


xjik + 1) = AfXf(k) + B fU (k) + Kfyfk + 1) - C f A f x f (k) - C f B f u(k)\ 
y f (k) = CfXf(k) (7.31) 


The filter matrix Kf is determined as 

K f = DjCj (i C f D f Cj + IQ- 5 )” 1 , (7.32) 


where the matrix Df is obtained as the positive semidefinite solution of the discrete¬ 
time matrix algebraic Riccati equation 

A f D f A T f - D f - AfDfCj(CfDfCj + 10 - 5 y l C f D f A T f 

+J f D v/ jJ = 0 (7.33) 

and the matrix D Vf = / 3 is the variance of the noise x y. Note that in (7.32) and (7.33), 
the variance of the zero output noise in (7.30) is taken equal to 10 -5 to avoid singularity 
of the corresponding matrix. The matrix Kf is computed by the function kalman of 
MATLAB. 

The quantity <p(k), which is used in computation of the estimate (7.26), is obtained 
as shown in (7.28) where <fi g (k) is the last element of the state estimate xj. 

The magnitude responses of the LQG controller obtained in respect to the inputs 
r, <fi, and 0 are shown in Figure 7.28. 

As mentioned previously, a PI controller of the yaw motion is also designed. The 
yaw angular velocity i// is measured by a gyroscope of the same type as the gyro used 
to measure the tilt rate <p. This gyroscope contains a noise which is modeled by 
the additional equation 


i g (k+l)=f g (k) + J g v ig (k), 


(7.34) 


where Vj rg is a white Gaussian noise with unit variance and the coefficient J g is 
determined as described above. A second-order Kalman filter is designed to produce 
sufficiently accurate estimate t// of the yaw angle. 

In Figure 7.29, we show the closed-loop system for yaw motion control. The 
control actions u,_ and u R to the left and right motor, respectively, are produced by 
a PI regulator with coefficients K P = 2 and K r = 0.01. These coefficients ensure 
sufficiently fast and accurate dynamics of the yaw motion. The control signal mlqg 
from the LQG controller is added to the two motor signals. 
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LQG-controller magnitude plots 



Frequency (rad/s) 


Figure 7.28 Frequency responses of the LQG controller 



Figure 7.29 Block diagram of the yaw motion control 
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7.5 fi Controller design 


MATLAB files used in this section 


File 

Description 

olp_robot_2dof.m 

Determines the open-loop interconnection for 
the p synthesis 

unc_model.m 

Determines reduced order uncertainty model 

dms_robot_2dof.m 

Performs D-K iterations 

dfrs_mu.m 

Obtains the frequency responses of the 
closed-loop system with p controller 

clp_mu_sys.six 

Simulink model of the closed-loop system 


The ii controller is designed on the basis of the robot model with input 
multiplicative uncertainty representation, shown in Figure 7.24. 

To obtain good performance of the closed-loop system, we shall implement a 
two-degree-of-ffeedom controller. The block diagram of the continuous-time closed- 
loop system in that case is shown in Figure 7.30 where r e is the wheels reference angle 
and e p , e u are the weighted closed-loop system outputs. The aim of the controller K, 
determined by p synthesis, is to ensure robust stability and robust performance of 
the closed-loop system in the presence of input multiplicative uncertainty. In order 
to obtain better position accuracy, a feedback from the integrated tracking error 
err = r e — 9 is introduced to the controller. 

Let 


>c=[*,d,J (re ~ 0)j 



Figure 7.30 Block diagram of the closed-loop system it 


of ii synthesis 
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be the output feedback vector where f (r e - 9) denotes discrete-time integration of 
the difference r e — 9 using the forward Euler method. Assume that the controller 
transfer function matrix K is represented as 

K - [K r K y \ , 

where K r is the controller prefilter transfer function and 

«y=[K* K e 

is the output feedback transfer function matrix. The matrix K y is partitioned with 
respect to the dimensions of <p, 9, f (r e — 9). Then, the control actions are 
calculated from the expression 



= K r r e + + Kg9 + K fen f (r e - 9). 

Using the notation 


Gej,(.z) 

-G in t(z) 2 G^(z) _ 


G 0 „(z), G„. (z) = 



0 


0 

G, h (z) = 

1 

,-G int (z) 2 _ 

, G re (z) = 

0 

Gjnt( z ) 


where T s = 0.005 s is the sampling period, the closed-loop system is described by the 
following equations: 

Tc = G re r e + G u u + G n ^ + G„.«g, (7.36) 

u = K r r e +K y y c . (7.37) 

The weighted closed-loop system errors e p and e u satisfy the following equation: 


■ e 1 [ W p S 0 (G re 

_e u \ = W u Si(K r + 


b G u K r ) W p S„G n . W p S 0 G n6 
K y G re ) W u SiK y G n . W u SiK y G„. 


where S t = (1 — K y G u ) 1 is the input sensitivity transfer function and S 0 = (I — 
G u K y )~ l is the output sensitivity transfer function matrix. 
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As usual, the performance criteria used in controller design require the trans¬ 
fer function matrix from the exogenous input signals r e , nj,, and n§ to the output 
signals e p and e u to be small in the sense of || • H^, for all possible uncertain plant 
models. This leads to small weighted signals <p, 6, and f (r e — 9) and small control 
action u. The transfer function matrices W p and W u reflect the relative importance 
of the different frequency ranges for which the performance requirements should be 
fulfilled. 

The ii synthesis is applied for several choices of performance weighting functions 
that ensure a good balance between system performance and robustness. After several 
trials, the performance weighting function (in the continuous-time case) is chosen as 
low pass filter as 


W p (s) = 


s+ 1 
0 


0 

0.65 + 1 


0 

45+1 


and the control weighting function as a high-pass filter as 


WJs) = 


5/0.07 + 1 
5/200 + 1 


/30,000. 


Since in the given case the plant uncertainty is taken into account by the corresponding 
input multiplicative uncertainty, the transfer functions Afy, Nf, are set equal to one and 
n (ll = ng = 0. However, in order to obtain better convergence of the D-K iterations, 
two small noises with 2-norms equal to 10 -4 are added to the angular velocities <j> 
and 9, respectively. The /i-synthesis is done using the function dksyn from Robust 
Control Toolbox™. After the third iteration, the maximum value of ji is decreased 
to 0.736 and the final controller obtained is of 44th order. The controller order is 
reduced to 30th by using the command reduce of Robust Control Toolbox without 
deterioration of closed-loop performance. 

The controller magnitude plots in respect to the inputs r, <p, 9, and f err are 
shown in Figure 7.31. 

ft should be noted that the robust control law presented is designed in MATLAB 
using double precision (64 b) floating-point arithmetic. In our case, this control law 
is embedded in a processor which use single precision (32 b) arithmetic. This circum¬ 
stance may affect the behavior of the discrete-time closed-loop system. For instance, 
some controllers become unstable when implemented in single precision, which is 
undesirable in practice. For this reason, the controller stability in single precision 
should be checked after the design. 

The ji controller incorporates the same PI regulator of the yaw motion as the one 
used with LQG controller. 
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^-Controller magnitude plots 



Frequency (rad/s) 

Figure 7.31 Controller magnitude plots in case of p synthesis 


7.6 Comparison of designed controllers 


MATLAB files used in this section 


File 

Description 

dfrs_mu_uncertain.m 

Determines the frequency responses of LQG 
and p controllers 

robust_comparison.m 

Determines robust stability and robust 
performance for LQG and p controllers 

comparison_experiments .ir 

i Compares the experimental results for both 
controllers 


In this section, we compare the frequency domain properties of the two controllers 
designed. In the case of p controller we use a 30th-order approximation obtained by 
the function reduce. 

The Bode plots of the closed-loop system is shown in Figure 7.32. It is seen that 
for both controllers, the closed-loop bandwidth is approximately 1 rad/s, the LQG 
controller having the larger bandwidth. 

In Figures 7.33 and 7.34, we show the influence of the measurement noises in <p 
and 9, respectively, on the control action u. It is seen that the effect of noise in is 
much stronger than the effect of noise in 6. 














(deg) Magnitude (dB) 
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Bode plot of the closed-loop system 0(z)/r(z) 
From: In(l) To: [+Intgl] 



Frequency (rad/s) 

Figure 7.32 Bode plot of the closed-loop system 


Control sensitivity to <f>- noise 



Frequency (rad/s) 

Figure 7.33 Sensitivity of con trol to noise in 4> 
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Control sensitivity to 0-noise 



Robust stability 



Figure 7.35 Robust stability of the closed-loop system 
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Robust performance 



Frequency (rad/s) 

Figure 7.36 Robust performance of the closed-loop system 


In Figures 7.35 and 7.36, we show the plots of upper bounds on the structured 
singular value corresponding to the robust stability and robust performance, respec¬ 
tively, of the closed-loop system for both controllers. In both cases, the plant model 
with input multiplicative uncertainty is used in the analysis. For both controllers, the 
system achieves robust stability in respect to the uncertainties corresponding to the 
identification of robot model. For both controllers, the robust performance analysis is 
done for the same weighting functions used in the ji synthesis. For this reason, better 
performance margin is obtained in the case of the p controller. The LQR regulator 
with Kalman filter does not achieve robust performance in presence of uncertainties 
corresponding to the identified robot model. 

As disadvantages of the p synthesis, one may point out the difficult choice of the 
weighting functions as well as the possibility that the D-K iteration does not converge 
to a stabilizing controller. The p controllers usually are of high order which may be 
reduced significantly without performance deterioration. 

7.7 Experimental evaluation 


MATLAB files used in this section 


File 

Description 

DSP_controller_ver21qrc.six 
DSP_controller_ver21.six 
DSP_OP_ver2.six 

Simulink LQG controller model 
Simulink p controller model 

Interface program for data collection 
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Table 7.2 Wheels angle reference trajectory 


t (S) 

0 ref (deg) 

0<t < 10 

0 

io<t< io+i,ooo/4ef 

4ef (t - 10) 

10+ 1,000/dref < t < 140 

1,000 

140 < t < 140 + 2,000/4ef 

1,000 - 4ef (t - 140) 

140 + 2,000/4ef <t< 320 

-1,000 

320 < t < 320+ l,000/4ef 

-1,000 + 4ef(t- 320) 

320 <t< 400 

0 


Table 7.3 Yaw angle reference 


t (s) 

1^ ref (deg) 

0 < t < 60 

0 

60 < t < 80 

5 (t - 60) 

80 < t < 100 

100 

100<t< 120 

100 - 5 (t - 100) 

120 <t< 400 

0 


A simulation scheme of the control system and a specialized software in 
MATLAB/Simulink environment is developed to implement the robot control code 
for the two designed controllers. With the aid of Simulink Coder™ [9], Embedded 
Coder™ [34], and Code Composer Studio™, a code is generated from this soft¬ 
ware which is embedded in the Texas Instruments TMS320F28335 Digital Signal 
Controller [174], 

Several experiments with the two controllers designed are performed, and 
obtained results are compared. In this section, we present results related to track¬ 
ing wheels trajectories which are predefined as in Table 7.2. Each experiment has a 
duration of 400 s. The reference wheel velocity is constant during a specific trajec¬ 
tory and takes the values 9 re{ = 25, 35, and 50 rad/s for different experiments. The 
experiments are done on a laboratory floor covered by ceramic tails which leads to 
additional small disturbances due to the small gaps between tails. 

During each experiment, the yaw angle reference changes as shown in Table 7.3. 

Consider first the experimental results with LQG controller for wheel velocity 
equal to 25 deg/s. It is seen from Figures 7.37 and 7.38 that the wheels track accurately 
the reference, and the robots keeps well its vertical position. The usage of jr{k) instead 
of jr (k) ensures exact rotation of the robot around the vertical axis. It should be noted 
that there is an increasing with the time bias in the measured value of jr(k) due to the 
integration of the gyro noise (Figure 7.39). 

Let us compare now the transient responses of system with LQG and /i 
controller. 
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LQG—tracking position reference 
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LQG—body tilt angle 
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Figure 7.38 LQG—body tilt angle 
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LQG—tracking yaw angle reference 



Time (s) 

Figure 7.39 LQG—tracking yaw angle reference 


Tracking wheel angle reference 



Time (s) 


Figure 7.40 Tracking wheel angle reference 
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Body tilt angle 



Time (s) 

Figure 7.41 Tilt body angle 


In Figure 7.40, we compare the change of wheel angle for 0 Kf = 25 rad/s for the 
two controllers. (Here and after for clearer representation, the experimental results are 
shown for t < 100 s.) It is seen that in both cases, the tracking error is relatively small. 
There are some small oscillations in the case of /x controller which may be explained 
by the large controller gain and the presence of dead zones in the gear boxes. Also, 
there is some negligible increasing of the oscillations magnitude for both controllers 
in the period between t = 60s and t= 80s which is due to the influence of yaw angle 
reference changes in this period. 

The variations of the tilt body angle during the same experiments are compared 
in Figure 7.41. After the transient response due to the nonzero initial conditions dies, 
the tilt angle remains less than 1 deg for both controllers. The measured angle (j) 
contains a bias which is removed offline (for the /x controllers) and online (for the 
LQG controller) by using a 17th-order Kalman filter. It is interesting to note that this 
bias does not affect the vertical stabilization of the robot in case of /x controller which 
is due to the good filtration properties of the closed-loop system with such controller. 
That is why the inclusion of Kalman filter in the /x controller does not improve the 
closed-loop system performance in the given case. 

The tracking error during the yaw motion also remains small as shown in 
Figure 7.42 due to the usage of Kalman filter. 

Finally, the control action for both controllers does not exceed 25 U (1U of 
control corresponds to 0.094 V to motors) with maximum allowable value equal to 
50 (Figure 7.43). 
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Time (s) 


Figure 7.42 Tracking yaw angle reference 


Control 



Figure 7.43 Control action 
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Table 7.4 Controller performance for different speeds 


Controller 

<0-0 nS ) 

a(AX) 

<r(0) 

<T(+ ~ f ref) 

<r(u) 


(deg) 

(m) 

(deg) 

(deg) 


LQG 

1.19 x 10 1 

8.27 x 1(T 3 

5.48 x KT 1 

9.88 x 10” 1 

6.57 x 10° 

d 

1.97 x 10 1 

1.38 x KG 2 

1.10 x 10° 

6.35 x 10" 1 

5.89 x 10° 


In Table 7.4, we present the mean square values of variables characterizing the 
robot motion along the reference trajectory using experimental data for wheels veloc¬ 
ity d K f = 25 deg/s and for duration equal to 400 s which corresponds to 80,000 sample 
measurements. The variable er(AX) denotes the square mean value of robot position 
error computed as cr(A X) = Ra(0 - 0 ref ) 7T/180 for R = 0.04m. To avoid the influ¬ 
ence of the nonzero initial conditions, the first 2,000 samples corresponding to the 
first 10 s of each experiment are removed in the computation of mean square values. 
Both controllers perform well. The LQG controller produces better results in respect 
to the tracking of wheels and tilt angle but gives worse accuracy in respect to the 
yaw motion. The better accuracy of the LQG controller is at the expense of its poorer 
robustness. Also, the better accuracy of the ji controller in comparison to LQG con¬ 
troller in the yaw motion is explained with stronger suppression of the influence from 
the vertical stabilization channel. Note, however, that these conclusions are derived 
on the basis of few experiments for three reference trajectories with restricted duration 
and may not be valid in more general case. 

Further improvement of the closed-loop performance may be achieved by using a 
multivariable plant model comprising of the vertical stabilization and the yaw motion 
control. Determining such model may require implementation of identification 
methods intended for multivariable systems and may increase the controller order. 


7,8 Notes and references 

Two-wheeled robots have several peculiarities which make them challenging both 
from theoretical and practical point of view. The most popular commercial product, 
built on the idea of self-balancing two-wheeled robot, is the SegwayPersonal Trans¬ 
porter (PT), produced by Segway Inc., USA [175], Some of the SegwayPTs have 
maximum speed of 20 km/h and can travel as far as 39 km on a single battery charge. 
Another robot, the self-balancing two-wheeled robot NXTway-GS [176], built on the 
basis of the LEGO® Mindstorms NXT developer kit, is widely used in education. 
Also, the telepresence and video conferencing two-wheeled robot Double® [177] is 
an interesting example of this type of robots. 

The two-wheeled robots have dynamics which is similar to the inverted pendu¬ 
lum dynamics so that they are inherently unstable and should be stabilized around the 
vertical position using a control system. A detailed review of several results in the 
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area of two-wheeled robot control is done in Chan, Stol, and Halkyard [166], Dif¬ 
ferent kinds of proportional-integral-derivative (see Lee and Jung [178]; Ren, Chen, 
and Chen [179]; Qiu and Huang [180]), linear-quadratic (see Fang [181], Lupian 
and Avila [182], Sun, Lu, and Yuan [183]), or pole placement control laws (see 
Muralidharan and Mahindrakar [184]; Nawawi, Ahmad, and Osman [185]) are usu¬ 
ally implemented in order to achieve vertical stabilization and desired position of the 
robot in horizontal plane. Model predictive control for this purpose is considered in 
Azimi and Koofigar [186], and several fuzzy logic controllers are proposed, see for 
instance Sayidmarie et al. [187]; Wong et al. [188]; Xu, Guo, and Lee [188], Imple¬ 
mentation of nonlinear control methods is discussed in Li, Zhang, and Yang [189]; 
Zhuang, Hu, and Yao [170]; Raffo et al. [190], However, with all these controllers, 
it is difficult or even impossible to ensure robust stability and robust performance 
of the closed-loop system in presence of uncertainties and disturbances. There are 
a few papers devoted to the robust control of two-wheeled robots. Robustness is 
achieved by using control, see Hu and Tsai [167], Ruan and Chen [191], Shi- 
mada and Hatakeyama [192], disturbance observer, see Dinale et al. [193], or sliding 
mode control, see Wu, Liang, and Wang [194]; Yau et al. [195]. As it is well known, 
the fx controllers have the advantage that they may ensure both robust stability and 
robust performance of the closed-loop system, see Skogestad and Postlethwaite [87]; 
Zhou, Doyle, and Glover [82], An obstacle in the implementation of high-order /x 
control laws for stabilization of two-wheeled robots is the difficulties related to the 
development, testing, and verification of the necessary real-time software which is 
highly dependent on the type of digital controller platform used. These difficulties 
are reduced significantly using the technologies for automatic code generation and 
embedding implemented in MATLAB/Simulink program environment [9]. 
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Appendix A 

Elements of matrix analysis 


In this appendix, we summarize some standard results of matrix analysis, used in the 
book. 


MATLAB® functions used in this appendix 


Function 

Description 

inv 

Inverse of a nonsingular matrix 

eig 

Matrix eigenvalues 

svd 

Singular value decomposition 

rank 

Rank of a matrix 

norm 

Norm of vector, matrix, or system 


A.l Vectors and matrices 

A complex column vector v with n elements is written as 

m 


where v, , i = 1,..., n are complex scalars. Formally, we write v e C", ifv is a complex 
vector or v e & n , if v is a real vector. The row vector v T = [vi, v 2 ,..., v„] denotes 
the transposed of the vector v. 

Consider a complex n x m matrix A with elements a tJ = Rea,, + /Im a, r Here, 
n is the number of rows (number of “outputs,” when A is a transfer function matrix), 
and m is the number of columns (“inputs”). Formally, we write A e C" xm , if A is a 
complex matrix or A € M n Y "\ if A is a real matrix. If a matrix A is square (n = m), 
we say that A is nth order matrix. 

Matrix with all elements equal to zero is called zero matrix and is denoted by 
0 or by 0„ XB) when it is necessary to indicate its size. A matrix A with elements ay 
is diagonal if ay = 0 for i ^ j. The square diagonal matrix with diagonal elements 
equal to 1 is called unit matrix and is denoted by / (or by /„ when it is necessary to 
indicate its order). 
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The transposed of the matrix A is denoted by A T (with elements ap in position 
(if)), the conjugate of A by A (with elements Re ay - /Im ay), the conjugate transpose 
(Hermitian conjugate) of A by A H A r (with elements Re dp — y'lm dp). The trace 
Tr(/J) of a matrix A is the sum of its diagonal elements and det A is the determinant 
of A. 

The Kronecker product of the n x m matrix A and the matrix B is defined as 


a\\B a 12 B .., a\ m B 
a 2 iB a 22 B ... a 2m B 

a n \B a„ 2 B .., a nm B 


A square matrix A e C" x ” is nonsingular, if there is a matrix A~ x e C" x " (the 
inverse of A) such that AA~ l = I. In such case, one also has that A~ X A = I. A~ x is 
unique whenever it exists. lfA~ x does not exist, then A is singular matrix. If A e C" x " 
is nonsingular and b e C", then x — A~ l b is the unique solution of the linear system 
Ax = b. 

A square matrix Q is symmetric, if Q T = Q, and Hermitian, if Q H = Q. 
A Hermitian matrix is positive definite, if x H Qx > 0 for all nonzero vectors x e C. 
The positive definite matrices are nonsingular. A Hermitian matrix Q is positive 
semidefinite, if x"Qx > 0 for all x e C. The matrix Q is called a square root of the 
positive semidefinite matrix P if Q 2 = P. This is denoted as Q = VP- The complex 
matrix U is unitary, if 

U H U = I. (A.l) 


If the matrix U is unitary, then UU H = I and U 1 = U H . 

The real matrix U is orthogonal, if 

U T U = I. (A.2) 


If the matrix U is orthogonal, then UU T = I and U 1 = U T . 


A.2 Eigenvalues and eigenvectors 

Eigenvalues and eigenvectors. Let A is a complex n/n matrix. The eigenvalues 
Xj, i = l,2,..., n, are the n roots of the n-order characteristic equation 

det (XI —A) = 0 (A.3) 

of the matrix^. The (right) eigenvector vcorresponding to the eigenvalue Xj, is the 
nontrivial solution (y, f 0) of 

(A - Xfvj =04> Avj = XjVj. (A.4) 

The corresponding left eigenvectors vv, satisfy 

wf(A - Xjl) = 0 wfA = Xjwf. (A. 5) 

Note that the left eigenvectors of A are the (right) eigenvectors of A H . 
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The eigenvalues are sometimes called characteristic values. The set of eigenval¬ 
ues of A counting their algebraic multiplicity as roots of (A.3) is called spectrum of 
A and is denoted by h(A). The largest of the modules of the eigenvalues of A is the 
spectral radius of A, p(A) := max, /.,■(/) ) |. This is the radius of the smallest central 
circle in C, which contains A .(A). 

The positive definite matrices have real positive eigenvalues and the positive 
semidefinite matrices have nonnegative eigenvalues (some of the eigenvalues are 
equal to zero). 

Eigenvector corresponding to distinct eigenvalues are linearly independent. In 
case of multiple eigenvalues, an nth order matrix may have less than n linearly 
independent eigenvectors. Such matrix is called defective. 

If the n x n matrix A is nondefective, i.e., it has n linearly independent 
eigenvectors, it is possible to reduce it to diagonal form. If 

A = diag {Ai,..., A„}. (A.6) 

is a diagonal matrix which contains the eigenvalues of A and 

V = [v 1; v 2 ,... ,v„]; A = diag {A 1; ..., A„} 
is matrix with the corresponding eigenvectors, then 

AV = VA. (A.7) 

and 

A = V~ l AV. (A. 8) 

Such matrices are called diagonalizable. Note that a matrix may have multiple eigen¬ 
values, but nevertheless, it may be possible to reduce it to diagonal form. The 
symmetric nth order matrices always have n orthogonal eigenvectors and hence are 
diagonalizable. Furthermore, the positive definite and positive semidefinite matrices 
also are diagonalizable. In particular, if a real matrix Q is positive (semi)definite it 
may be represented as 

U t QU= A, U t U = I. (A.9) 


Therefore, the square root of a positive (semi)definite matrix may be computed 

Ve = uVau t = c/diag J yr u ..., v^) u T . 


A.3 Singular value decomposition 

Singular value decomposition (SVD). Each complex n x m matrix A can be 
represented by the singular value decomposition 


A = U'EV 1 


(A. 10) 
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where the n x n matrix U and the m x m matrix V are unitary, and n x m matrix £ 
is diagonal: 



or 

E = [E t 0]; n < m, (A.12) 

where 

£i = diag {eri,<T 2 , • • • , a k ); £ = min (n,m), (A.13) 

and 

a := G\ > a 2 > ... > a k := q_ (A. 14) 

The numbers cr, > 0 are called singular values of the matrix A. 

The columns of V, denoted by v,, are called right or input singular vectors, and 
the columns of U, denoted by are called left or output singular vectors. We define 
u := U\, v := V\;u u k andy := v k . 

The decomposition (A. 10) is not unique, since the matrices U and V are not 
unique. However, the singular values cr, are unique. 

The rank, rank(4), of an n x m matrix A is the number of its positive singular 
values. Let rank(A) = r. Then, the matrix A is called rank deficient if r < k = 
min (n, m). In this case cr, = 0 for i = r + 1,..., k. A rank deficient square matrix is 
a singular matrix. 

It follows from the SVD definition that 
d(A H ) = d(A) and a(A r ) = d(A). (A.15) 

An important property of the singular values is that 

a(AB) < b{A)a(B). (A. 16) 

For a nonsingular matrix A (or B ), we have the inequalities 
o{A)d{B) < cr(AB) or a(A)a(B) < ct(AB). (A. 17) 

The following inequality also holds 

(t(A)cj(B) < cx(AB). (A. 18) 

For a nonsingular square matrix A, we have that 
ct(^ _ 1 ) = and B(A) = J . (A. 19) 

Other useful relationships for the singular values are ( Fan’s inequalities ) 
a (A) — d{B) < a (A + B) < a (A) + d(B), (A.20) 

and 

ct(A) - 1 < ^ < a(A) + 1, (A.21) 

cr(7 + A)- 1 

provided that I + A is nonsingular. 
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A.4 Vector and matrix norms 

In many cases, it is useful to have a single number which characterizes the size of a 
vector, matrix, signal, or system. For this purpose, we use functions which are called 
norms. 

A norm of the element v (vector or matrix) is a real number, denoted by ||v||, 
which satisfies the following properties: 

1. Nonnegativity: ||v|| > 0, as ||v|| = 0 exactly when v = 0. 

2. Homogeneity: ||o!v|| = |a| \\v\\ for all complex scalars a. 

3. Triangle inequality: 

I|v + W|| < ||v|| + |M|. (A.22) 

A.4.1 Vector norms 

Consider a column vector v with n real or complex elements v,. We shall consider 
three norms which are special cases of the vector p- norm 

IMI^El^) 1 ^ (A.23) 

where it is necessary to have p > 1 to satisfy the triangle inequality (property 3 of 
norm). Here, v,| is the module of the complex scalar v,. To illustrate the different 
norms, we shall compute each of them for the vector 



Vector 1-norm (or norm-sum). We have that 

IMIi := N (IN!.: - 1+2 +3 = 6). (A.24) 

Vector 2-norm (Euclidean norm). This is the most frequently used vector norm 
which is interpreted as a vector length. We have that 

IIv|| 2 := (||z|| 2 = Vl +4 +9 = 3.7417). (A.25) 

The Euclidean norm satisfies the property 

v"v = ||v|N (A.26) 

where v H is the Hermitian conjugate of the vector v. 

Vector norm oo. This the maximum in module vector element. We use the notion 
IMImax, SUCh that 


iaxk| (||z|| max =|-3| = 3). 


(A.27) 
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* 



Figure A.l Contours for the vector p-norm, |ja|j p = 1 for p = 1,2, oo 


For all p,q > 1, there exists a constant c pq , such that ||a|| p < c pq \\a\\ q for each a. In 
this sense, the /7-norms frequently are called equivalent. For instance, for a vector v 
with n elements, it is fulfilled that 


I|V|| 2 < V«l|v|| m ax, 


(A.28) 

(A.29) 


|v|| 2 < ||v||i < Vn ||v|| 2 . 


Figure A.l illustrates the difference between the vector norms by plotting the line 
||v||p = 1 in^ 2 . 

A.4.2 Matrix norms 

Consider the constant matrices A,B,.... The n x m complex matrix A may represent, 
for example, the value for particular co of the frequency response G(Jco) of the system 
G(s) with m inputs and n outputs. 

The quantity \\A || is a matrix norm, ifin addition to the three properties ofnorms, 
it also satisfies the multiplicative property 


\\AB\\ < M||||fi||. 


(A.30) 


The condition (A.30) is important in considering the properties of system 
connections. 

For a numerical illustration, we shall use the 2 x 2 matrix 
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FigureA.2 Representation of (A.32) 


One of the most frequently used matrix norms is the Frobenius matrix norm (or 
Euclidean norm). It is defined as the square root of the sum of squares of the modules 
of matrix elements, 


Uh= /l>yl 2 «VlW (||M|| f = V9l = 9.5394). (A.31) 

The most important matrix norms are the so-called induced matrix norms which 
are closely related to the amplification of signals in systems. Consider the following 
equation illustrated in Figure A.2: 

z = Aw. (A.32) 


We may consider w as an input vector, and z as an output vector and to consider “ampli¬ 
fication” of the matrix A, defined by the ratio ||z|| /1| w||. The maximum amplification 
over the all possible input directions, i.e., all possible directions of the vector w, 
represents a special interest. It is given by the induced norm, which is defined as 


U\\ P 


\\Aw\\ p 

= max-, 

||w|| p 


(A.33) 


where || w\\ p = ( 'ff ii \w^) 1/p denotes the vector /7-norm. In other words, we look for 
a direction of the vector w, such that the ratio ||z||p/||w||p is maximized. In this way, 
the induced norm yields the maximum possible “amplification” of a matrix. The 
following equivalent definition is also used: 


\\A\\ P = max \\Aw\\ p = max \\Aw\\ p . (A.34) 

IMIp<l llw||p=l 

The geometric interpretation of the induced norm is that it is the maximum norm 
of all vectors z, obtained after transformation by the matrix A of all vectors w, having 
unity norm. This is illustrated in Figure A. 3 for vectors in 3% 2 with 2-norm. 

The induced 1, 2, and oo matrix norms can be determined from 


M| = max j 

a,y | ^ “maximum column sum” 

(A.35) 

Mil oo = max 

a t j | ^ “maximum row sum” 

(A.36) 

IMIlfe = 

= yjp(A }1 A) “spectral norm” 

(A.37) 
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Mw|| 2 =1} 



where the spectral radius p(M) = max, a, (A) is the largest eigenvalue of the 
matrix^. The induced 2-norm of a matrix is equal to its maximum singular value and 
is called spectral norm. For the example matrix we obtain 

\\M\\i — 9; IMloosil; \\M\\ 2 = o(M) = 8.8772. 


All induced norms \\A\\ p are matrix norms and satisfy the multiplicative property 


\\AB\\p < 

(A.38) 

A.4.3 Relationships between matrix norms 


Let A e C" xm , then 


d(A)< \\A\\ f < Jmin(n,m) °(A), 

(A.39) 

d(A) < VlMIUIMNoo, 

(A.40) 

^Ml» < z(A) < Vi piu 

(A.41) 

< d(A) < 4m ||/4||i. 

(A.42) 


All these norms satisfy (A.30). 

A very important property of the Frobenius norm and the induced norm is that 
they are invariant to unitary transformations, i.e., for unitary matrices Ui,i =1,2, 
satisfying Uf = 7, we have that 

\\UiAU 2 \\f = \\A\\ P , (A.43) 

d(U x AU2) = d(A). (A.44) 
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From the singular value decomposition of the matrix A = UY V H and (A.44), one 
obtains a relationship between the Frobenius norm and the singular values rr,(/f), 


11 % = 




(A.45) 


It follows from this equation that \\A ||/7 = ||d|| 2 exactly when the rank r of A is equal 
to 1. Also it is seen that 

\fra r < HAIIj? < Vrcq. (A.46) 

According to the Perron-Frobenius theorem, which applies to a square matrix A, 
it follows that 

nun || DAD- 1 1|! = min \\DAD~ l §* = p{\A\), {AM) 

where D is a diagonal scaling matrix, \A\ is a matrix whose elements are the modules 
of the elements of A and p{\A\) = max, a,(|/(|)| is the Perron root (Perron-Frobenius 
eigenvalue). 


A.5 Notes and references 

The material presented in this appendix is standard. A profound and rigorous treatment 
of matrix analysis is presented in Horn and Johnson [196], Useful facts from matrix 
analysis in connection with linear systems theory can be found in Bernstein [197] and 
Laub [198]. 
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Appendix B 

Elements of linear system theory 


In this appendix, we present without proofs some basic results from the theory of 
Linear Control Systems. 

MATLAB® functions used in this appendix 


Function 

Description 

ss 

Constructs state-space model 

tf 

Derives transfer function matrix 

ctrb 

Computes the controllability matrix 

obsv 

Computes the observability matrix 

minreal 

Determines minimal realization 

lyap 

Solves the Lyapunov equation 

dlyap 

Solves the discrete Lyapunov equation 

pole 

Computes poles of a linear system 

tzero 

Computes invariants zeros of a linear system 


B.l Description 

A linear continuous time-invariant control system (continuous LTI system ) is 
described by the set of differential and algebraic equations of the form 

x(t) = Ax(t) + Bu(t), x(0) = Jt 0 , (B.l) 

y(t) = Cx(t) + Du(t), (B.2) 

where x(t) e R" is the state vector, u(t ) e fX! m is the input vector, and y(t) e is the 
output vector; the matrices A, B,C, and D are real constant matrices with appropriate 
dimensions. 

A linear system with single input (m = 1) and single output (r = 1) is called a 
SISO (single-input-single-output) system; otherwise, it is called a MIMO (multiple- 
input-multiple-output) system. 

The transfer function matrix of the system (B.l), (B.2) from u toy is defined by 
Y(s) = G(s)U(s), (B.3) 
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where U(s) and Y(s) are the Laplace transforms of u(t) and y(t), respectively, with 
zero initial conditions. It is easy to show that 

G(s) = C(sl - A)~ X B + D. (B.4) 


The transfer matrix G(s) is proper if D 0 and strictly proper, if D = 0. 

The following notation is frequently used 


C(sl - A)~'B + D. 


A linear discrete time-invariant control system ( discrete-time LTI system ) is 
described by the set of difference and algebraic equations of the form 


x(k + 1) = Ax(k) + Bu(k), 
y(k ) = Cx(k) + Du(k), 


(B.5) 

(B.6) 


where x(k), u(k), and y(k) are the state vector, input (control) vector, and output vector, 
respectively, at the time t = kAt and where A, B, C, and D are constant matrices. 

The transfer function matrix of the discrete-time system (B.5), (B.6) from u toy 
is defined as 


Y(z) = Giz)U(z), (B.7) 

where U(z) and Y(z) are the z transforms of u(k) and y{k), respectively. One has that 
G(z ) = C(zl - A)~ l B + D. (B.8) 

The transfer function matrix is invariant under nonsingular state transformations. 


B.2 Stability 

An unforced continuous-time linear system 

m=Mt ) 

is said to be stable if all the eigenvalues of A are in the open left half plane, i.e., 
ReA.(A) < 0. A matrix with such a property is said to be stable. 

An unforced discrete-time linear system 

x(k + 1) = Ax(k) 

is said to be stable if all the eigenvalues of A are inside the unit circle, i.e., A(/t)| < 1. 
A matrix with such a property is said to be stable or convergent. 


B.3 Controllability and observability 

The linear system (B.l) or the pair (A, B) is said to be controllable if one of the 
following equivalent conditions hold: 

1. Given any x 0 , t\ > 0 and X\ , there exists an input u{.) such that the solution of 
(B.l) satisfies x(t\) = x\. 
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2. The controllability matrix 

M c = [B AB A 2 B...A n ~ l B ] 
has full row rank, i.e., rank M c = n. 

3. (Popov-Belevitch-Hautus test for controllability). The matrix [A — XI, B] has 
full row rank for all X £ if. 

4. Let X and w be any eigenvalue and the corresponding left eigenvector of A (i.e., 
w r A = Xw r ); then w T B ^ [0 0... 0], 

5. There exist an m x n matrix K such that the eigenvalues of A + BK can take on 
arbitrary values. 

If the above conditions are not fulfilled, then the system or the pair (A,B) is said to 
be uncontrollable. 

If the pair ( A,B ) is uncontrollable, then there exists a nonsingular T such that 

TAT~ l [^j 1 ] , TB = [ q 1 ] , CT~ X = [Q C 2 ] (B.9) 

with Mi!, 5|) controllable. In this case, the transfer function matrix of the system is 
given by 

G(s) = Cfsl-A u y'B l + D, 

which shows that the transfer function represents only the controllable part of the 
system. 

The linear system (B.l) or the pair (A,B) is said to be stabilizable if there exists 
a state feedback u{t) = Kx(t ) such that A + BK is stable (i.e., Rek,M + BK) < 0). If 
the system is stabilizable and the pair (A n ,B\)'m representation (B.9) is controllable, 
then the matrix An is stable. 

The linear system described by (B.l) and (B.2) or the pair ( C,A) is said to be 
observable if one of the following equivalent conditions hold: 

1. For any t\ > 0, the initial state x(0) = xq can be determined from the time history 
of the input u{t) and the output y( t) in the time interval [0, t\). 

2. The observability matrix 



has full column rank, i.e., rank M a — n. 

3. The matrix 



has full column rank for all X £ iff. 
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4. Let X and v be any eigenvalue and the corresponding right eigenvector of A (i.e., 
Av = A.v); then Cv f 0. 

5. There exist an n x r matrix L such that the eigenvalues of A + LC can be freely 
assigned. 

6. The pair (A r , C T ) is controllable. 

If the above conditions are not fulfilled, then the system or the pair ( C,A ) is said 
to be unobservable. 

If the pair (C,A) is unobservable, then there exists a nonsingular T 0 such that 
CT~' = [Ci 0], TAT-' = YZl\ ra =[!;] 

with (C|,/f,i) observable. In this case, the transfer function matrix of the system is 
given by 

G(s) = Cfsl - A u )-' B t +D, 


which shows that the transfer function represents only the observable part of the 
system. 

The linear system described by (B.l), (B.2) or the pair (C,A) is said to be 
detectable if there exists an output injection matrix L such that A + LC is stable. If 
the system is detectable and the pair (C|,4 n ) in representation (B.10) is observable, 
then the matrix A 22 is stable. 

The linear discrete-time system (B.5) or the pair ( A,B ) is said to be reachable if 
one of the following equivalent conditions hold. 

1. Given x 0 = 0, there exists an input {u(k)} for k e [0, n — 1] such that x„ takes an 
arbitrary value. 

2. The reachability matrix 

M c = [B AB A 2 B...A n ~ l B ] 

has full row rank, i.e., rank M c = n. 

3. The matrix [A — XI, B] has full row rank for all X e c €. 

4. Let X and w be any eigenvalue and the corresponding left eigenvector of A (i.e., 
w t A = Xw T ); then w T B ^ [0 0... 0]. 

5. There exist an m x n matrix K such that the eigenvalues of A + BK can take on 
arbitrary values. 


If the above conditions are not fulfilled, then the system or the pair (A, B) is said to 
be unreachable. 

The discrete-time system (B.5) or the pair (A, B ) is said to be stabilizable if there 
exists a state feedback u(k ) = Kx(k) such that the eigenvalues of A + BK are inside 
the unit circle, i.e., \X(A + BK) \ < 1. If the system is stabilizable and the pair (T11,5|) 
in representation 


TAT - 1 


A\\ A\i 

0 A 22 _ 


TBm 


is reachable, then \X,(A 2 2)\ < 
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The discrete-time system described by (B.5) and (B.6) or the pair ( C,A ) is said 
to be observable if one of the following equivalent conditions hold: 

1. Knowledge of [u(k)} and \y(k)\ for k e [0 ,n— 1] suffices to determine x 0 . 

2. The observability matrix 



has full column rank, i.e., rank M a — n. 

3. The matrix 



has full column rank for all A. e c €. 

4. Let A. and v be any eigenvalue and the corresponding left eigenvector of A (i.e., 
Av = av); then Cv f 0. 

5. There exists annxr matrix L such that the eigenvalues of A + LC can be freely 
assigned. 

6. The pair (A r , C T ) is reachable. 

The discrete-time system described by (B.5) and (B.6) or the pair ( C,A ) is said to 
be detectable if there exists a matrix L such that the eigenvalues of A + LC are inside 
the unit circle, i.e., | X(A + CA)\ < 1. If the system is detectable and the pair (Ci,A n ) 
in representation 

CT-' = [C.OJ, TAT -> = [££] 
is observable, then \Lj(A 2 2)\ < 1. 

Assume that G(s) is a real rational transfer function matrix that is proper. Then, 
the state-space model (A, B, C,D ) that satisfies 



is called a realization of G(s). The matrix A is of minimal order if and only if the pair 
(A,B) is controllable and the pair (C,A) is observable. In such case, the realization 
( A,B , C,D) is called minimal realization of G(s). 

B.4 Lyapunov equations 

The Lyapunov equations play fundamental role in the stability, controllability and 
observability analysis, as well as in the optimization of deterministic and stochastic 
linear systems. 
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Consider first the continuous Lyapunov equation 

A t P + PA + Q = 0 (B.l 1) 

with given n x n real matrices A and Q, Q r = Q. This equation has a unique solution 
for P if and only if A . t (A) + A y (A ) f 0. 

Assume that A is stable, then P > 0 if Q > 0 and P > 0 if Q > 0. If A is stable 
and Q > 0, then (fj), A) is observable if P > 0. Hence for a stable A, the pair (C',A) 
is observable if and only if the solution of the Lyapunov equation 

A t L„ +L 0 A + C t C = 0 

is positive definite. The solution L 0 is called the observability Grammian and is 
expressed as 

L„ = J e AT, C T Ce A, dt. 

The Lyapunov stability criterion for continuous LTI systems can be formulated 
as follows. 

Suppose P is the solution of Lyapunov (B. 11). Then A is stable if P > 0, Q > 0, 
and (V Q,d ) is detectable. If (VQ,A) is observable, then actually/ 5 > 0. 

In state estimation problems the Lyapunov equation appears in the dual form 

AP + PA T + Q = 0. (B.12) 

IfP > 0, Q > 0 and (A, fQ) is stabilizable, then A is stable. Furthermore, if (A, fQ) 
is controllable, then P is positive definite. For a stable A, the pair (A, B ) is controllable 
if and only if the solution of the Lyapunov equation 

AL C + L c A t + BB t = 0 

is positive definite. The solution L c is called the controllability Grammian and may 
be expressed as 

L c = [ e At BB T e AT, dt. 

Jo 

Consider now the discrete Lyapunov equation ( Stein equation) 

A r PA-P + Q = 0 (B.13) 

with given n x n real matrices A and Q, Q r = Q. This equation has a unique solution 
for P if and only if Xi(A)Xj(A) f 1. 

Assume that A is stable, then P > 0 if Q > 0 and P > 0 if Q > 0. For a stable A, 
the pair ( C,A ) is observable if and only if the solution of the equation 

A t L 0 A -L 0 + C t C = 0 

is positive definite. The observability Grammian L 0 is expressed as 
L 0 = Y^,A Tk C T CA k . 
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The Lyapunov stability criterion for discrete-time systems can be formulated as 
follows. Suppose Pis a solution of (B. 13). Then A is stable, i.e., |A.,04)| < 1, ifP > 0, 
Q > 0 and (V Q,A ) is detectable. If (fQ,A) is observable, then actually P > 0. 
Consider the dual discrete-time Lyapunov equation 

APA t -P + Q= 0. (B.14) 

If P > 0, Q > 0, (A, fQ) is stabilizable, then A is stable. Furthermore, if (A, fQ) is 
controllable, then P is positive definite. 

In the discrete-time case, the controllability Grammian is a solution of 

al c a t -l c + bb t = 0 

and is expressed as 

L c = jrA k BB T A Tk . 

The Lyapunov equation (B. 12) is solved by the MATLAB function lyap and the 
discrete Lyapunov equation (B.14)—by the function dlyap. 


B.5 Poles and zeros 

Let 



be the minimal realization of the transfer function matrix G(s). Then, the eigenvalues 
of A are called poles of G(s). 

A complex number z 0 is called an invariant zero of the system realization if there 
exists a vector T ^ 1 ^ 0 such that 



Let G(s) be a real rational proper transfer function matrix and (A, B, C,D) is its 
minimal realization. Then, a complex number z 0 is a transmission zero of G(s) if and 
only if it is an invariant zero of the minimal realization. 

Consider a SISO system with strictly proper transfer function G(s) and let 
( A,B,C ) be a realization of G(s). If the matrix A is nondefective, i.e., has a full 
set of linearly independent eigenvectors, then G(s) may be represented as 

, .A CV:W T B 
G(s) = C(sl - A)~'B = J2 -yzj-’ 

where A., is an eigenvalue of A and v„ w, are the corresponding right and left eigen¬ 
vectors. The pole A, will appear in the transfer function only if the products Cv,- and 
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wjB are both nonzero, i.e., only if the realization is controllable and observable. If 
for some i it is fulfilled that CV, or/and wf B = 0 then the pole is canceled by zero. 
This shows that if the realization is uncontrollable or unobservable, then zero/pole 
cancelation will occur in the transfer function. 

In contrast to the SISO systems, a MIMO system may have pole and zero at the 
same location, see for an example [82, p. 83], 


B.6 Notes and references 

The linear system theory is presented in several good books, among them Antsaklis 
and Michel [199], Callier and Desoer [98], Fairman [200], Kailath [201], and 
Wonham [202], 



Appendix C 

Stochastic processes 


In this appendix, we present some notation and basic facts pertaining to the theory 
of stochastic processes. For a systematic and rigorous treatment of this subject, the 
reader should consult the references given at the end of the appendix. 


C.l Random variables 

Let v be a real, scalar random variable (RV). The probability that the RV v is less than 
the real number V is denoted by 

P(v < V). 

The distribution function of the RV v is defined as 
F v (V) = P(v < V ). 

The derivative of the distribution function is the densityfunction of the RV v denoted by 

Mn = ^(n 

The density function represents the probability that the RV v assumes a value in the 
infinitesimal interval (V, V + AV). Since the range of V is divided into elements of 
length dV and p v (V)dV is the probability of falling into one of these elements, the 
density p v (V) is a function which shows the relative probability of v falling into the 
interval dV at V. 

The outcome of a particular experiment is called a realization. Note that the 
realizations of an RV are not equal to the RV itself and RV exists independently of 
any of its realizations. 

The expected value (also called the expectation, the mean, or the average ) of 
an RV is defined as its average value over a large (theoretically infinite) number of 
experiments. Specifically, the mean of v is defined as 

m v =E{v} = J Vp v (V)dV. (C.l) 

The variance of a scalar valued RV v is defined by 

o v 2 = E{(v - m v ) 2 } = J (V - m v ) 2 p v ( V)dV. 


(C.2) 
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The variance of an RV is a measure of how much we expect the RV to vary from its 
mean. 

The standard deviation of an RV is a, which is the square root of the variance. It 
is possible to show that 

a v = E{v 2 } - m 2 v (C.3) 

where E{v 2 } is the mean squared value of v. The quantity 



is called root mean squared value of v. 

In general, the z'th moment of an RV v is the expected value of the z'th power of v. 
The z'th central moment of an RV v is the expected value of the z'th power of v minus 
its mean: 

z'th moment of v = E{v’}, 

z'th central moment of v = E{(v — m v f\. 


For example, the first moment of an RV is equal to its mean, the first central moment 
is equal to 0 and the second central moment is equal to the variance. 

An RV x has the Gaussian or Normal distribution if its density function is 
described by 

= <C4) 


J Xp x (X)dX = m and 
J (X- m) 2 p x (X)dX = a 2 . 


it follows that m and o are the expected value and standard deviation of the RV x. The 
notation x ~ N(m, a 2 ) is used to indicate that the scalar RV x has a Gaussian distri¬ 
bution with mean m and variance a 2 . Hence, the Gaussian distribution is completely 
specified only by these two parameters. 

The probability distribution function for a normally distributed RV is given by 


The probability that a normally distributed variable x(t) will be between m — a 
and m + a is given by 



P((m -a)< x(t) <(m + a)) = erf 


(C.5) 
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where the function erf(.) is defined as erf(x) = 2F(x) — 1 and is available in 
tabulated form. Equation (C.5) leads to the following relationships: 

P(\x(t) — m\ < a) = 0.6827, 

P(\x(t) - m\ < 2a) = 0.9545, (C.6) 

P{\x{t) -m\< 3cr) = 0.9973. 

The expressions (C.6) show that a Gaussian RV must remain within the bounds 
±3er of its mean 99.73% of the time for sufficiently large number of experiments. This 
is very useful in practice when an estimate of the standard deviation a is available. 

For the vector RV x = \x\,x 2 ,... ,x„] T , the notation x ~ N(m,P ) is used to 
indicate that x has the multivariate Gaussian or Normal density function described by 

p x (X) = 1 = exp (~\{X - m) T P~ x (X - . 

V(2w)»det(P) V 2 V 7 

Similarly to the scalar case, the density of the vector Gaussian RV is completely 
determined by the mean value m — [mi, m 2 ,..., m„] T and the n/n covariance 
matrix P. 

According to the Central Limit Theorem, if n RVs are independent and identically 
distributed, then the distribution of their sum will converge to a normal distribution 
as n becomes large. This is a fundamental result which explains the wide application 
of the Gaussian distribution in the analysis of random processes. 

A discrete RV 'k one that can only assume discrete values. The distribution and the 
density functions can be defined for discrete RVs in the same way as for continuous 
variables except that the integration must be replaced by summation. 

If the values of the discrete RV v are denoted by V t , i = 1,... ,N, then the 
expectation or average value of this variable is given by 

E{v) = Y J V i P{v=V-), 

i= 1 

where N is infinite in some cases. 


C.2 Stochastic processes 

A stochastic process, also called a random process, x(t), is an RV X that changes with 
time. The process x(t) can be either a scalar or a vector. The outcome of a particular 
random experiment is called a realization. 

For a vector stochastic process x(t) = [xi(t),x 2 (t ),... ,x„(t)] T , the mean of the 
process is a vector of the means of process components, 

m x (t) = E [x(t)} = [E {*,(0), E {x 2 (t)} ,...,E {x n (t)} f, (C.7) 

E{.\ denotes mathematical expectation. 

The vector stochastic processes are characterized by the following second 
moments. 
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• Crosscorrelation function between two stochastic processes x(t) and y(t), 

R X y(tut2) = E{x(f)y(t2) T }. (C.8) 

• Autocorrelation function of a stochastic process x(t), 

R x (t u t 2 ) = E {x{h)x{t 2 ) r }. (C.9) 

• Crosscovariance function between two stochastic processes x(t) and y(t), 

C^tuh) = E {[xf) - m x ( tl )]\y(t 2 ) - mftff] . (C.10) 

• Autocovariance function of a stochastic process x(t), 

CAtuh) = E {[xf ) - m x (umt 2 ) - m x (t 2 )f\ . (C.ll) 


The matrices R x {t\,ti) and C x {t\,t 2 ) are symmetric. For instance, the autocorre¬ 
lation matrix is given by 

RAtuti) = E\x(h)x(h) T \ 

~ X\(t\)x\(t 2 ) xAh)x 2 (t 2 ) ■■■ xAh)x n (t 2 y 

_xAh)x x {t 2 ) xAtfx 2 (t 2 ) ■■■ x n (ti)x n {t 2 ) _ 

The covariance matrix of a random process is obtained from the autocovariance 
function for t\ = t 2 = t, 

PAt) = E {[x(t) - mAt)][x(t) - mAt)f\ . (C. 12) 

Note that P x (t) is an n x n matrix which is positive semidefinite for all t. 

The autocovariance function is equal to the autocorrelation function when the 
random process has zero mean. In general, the autocovariance function can be 
expressed in terms of the autocorrelation function and the mean as 

CAtuh) = RAtuti ) - mAh)m T x (t 2 ). 

If the crosscorrelation function 
R xy {h,t 2 ) = E{x{t l )y(t 2 ) T } 

between the Gaussian processes x(t) and y(t) is equal to zero for all h,t 2 , then these 
processes are called independent. 

Two random processes x(t) and y(t) are uncorrelated with each other if, for all 
tuh, 

E {x(f)y T (t 2 )\ = m x (t\)m T y (t 2 ) 
or, equivalently, if 

E {[x( t] ) - mAtOmti) ~ mAti)] T } = 0. 

If two stochastic processes are independent, then they are also uncorrelated. 

A stochastic process x(t) is stationary if its distribution is independent of time. 
A stochastic process is wide sense stationary (WSS) if the mean and the variance of 
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the process are independent of the time. A WSS process must have a constant mean 
and its correlation and covariance can only depend on the time difference t = t\ — t2 
between the occurrence of the two RVs, i.e., 


E \x{t x )x(t 2 ) T ) = R x ( r). 

Stationary processes are WSS but the WSS does not imply strict-sense stationary. 
However, in the special case of Gaussian processes, a WSS process is strict-sense 
stationary as well. 

A stochastic process is said to be ergodic if a certain moment calculated by 
averaging over the members of an ensemble at a fixed moment of the time has the same 
value as calculated by time averaging over any particular realization, given sufficient 
time. The ergodic processes are stationary processes, but not every stationary process 
is ergodic one. The ergodicity assumption is very useful in practice, since it is often 
quite easy to obtain a sufficiently long time sequence, but may be quite difficult 
to obtain an ensemble of time sequences. If this assumption holds, the statistics of 
the ensemble of a stochastic process may be obtained as the corresponding temporal 
statistics computed from appropriate data sequence. 

The power spectral density (PSD) of a wide sense stationary random process x(t) 
is defined as the Fourier transform of its autocorrelation function R x (x), 

S x (co) = j R x (x)e iwT dx. (C.13) 


From the Fourier inversion formula, it follows that 


^-hs: 


S x (w)e jmr da>. 


(C.14) 


The PSD is a quantity, which is proportional to the power of the random process 
in the interval from co to a> + dco. Note that S x (cd) is always positive. If x(t) is a real 
process, then R x (x) is real and even; hence, S x (co) is also real and even. The function 
S x (co) is frequently called two-sided PSD. 

The PSD is typically specified in units of (quantity) 2 /hertz. 

An important property of the PSD is that its integration over all frequencies from 
—oo to oo gives the average power of the function x(t), i.e., 

— [ S x (co)dco = R x ( 0) = E{x(t)x T (t)}. (C.15) 

2n J- oo 


In case of real signals, it is possible to consider the spectral density only for positive 
values of the frequency. For a real signal, one has that 

2 ^ f°° S° x (co)dco =^f_ S x (a))d(o = E{x(t)x r (t)}, 

where S°(cd j = 2S x (co) is the spectral density for positive frequency values. The func¬ 
tion S x (a>) is called the one-sided PSD . The one-sided PSD contains the total power 
of the random signal and is used frequently in the graphical representation of the PSD 
which is plotted as a function of/ on a log-log plot. 
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Figure C. 1 Input and output spectral densities 


Consider a linear system with transfer function matrix G{s) (Figure C.l). The 
power spectral densities of the system input and output are related by 

S y (ai) = G(jaj)S x (u)G T (-joj). (C.16) 

In the single-input-single-output case where y andx are both scalars, (C.16) reduces to 
S y (oj) = \G(joj)\ 2 S x (jof. (C.17) 

According to (C.17), in the scalar case, the mean squared value of the system output 
is given by 

E{y 2 } = 2 ^ J°° S y (co)dco = ±- f I G(Jco)\ 2 S x (Jco)dw. (C.18) 

A discrete-time stochastic process is a sequence of RVs. Discrete-time random 
processes have characteristics which are analogous to those of continuous processes 
and are described in a similar way. 

The mean or expectation value of the stochastic process x(k) is defined as 


m x (k) = E{x(k)}. (C.19) 

The autocorrelation function of the process is 
R x (k,j) = E {x(k)x(j) T }, (C.20) 

while the covariance matrix is 

C x (k,j ) = E {[x(k) - m x (k)][x(j) - m x {j )] T }. (021) 

The covariance matrix of the process is 
P x (k) = E \[x(k) - m x (k)][x(k) - m x (k)f\ . (C.22) 


A WSS discrete-time process fulfills the conditions: 

m x (k) = const (in its components), 

R x (k,k) = E {x(k)x(k) T } < oo (in its elements), 

C x (kJ) = E {[*(*) - m x (k)][x{j) - m x (J)\ T } = C x (k -j). 

The PSD S(co) of a WSS discrete-time process x(k) is defined 
S x (oj) = Y2 R Ak)e- jk " J 


(C.23) 
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which is valid for — n < co < it. One has that 

R x (k) = — f S x (oj)e jkoi dco (C.24) 

J—ix 

and hence 

R x (0) = E {x(k)x(k) T \ = J S x (co)dco (C.25) 

Let an asymptotically stable time invariant linear discrete-time system, described 
by the transfer function matrix H(z), has as an input x(k) a WSS discrete-time 
stochastic process with PSD S x (cd). Then, the output y(k) of this system is a realization 
of a discrete-time stochastic process with PSD given by 

S y (co) = H(e Ja, )S x ((o)H T (e- jm ). (C.26) 


C.3 White noise 


A scalar continuous-time random process v(t) is referred to as a white noise process 
if its PSD is constant over the whole frequency range, i.e., 

S v (co) = <r 2 , (C.27) 

where er 2 is the noise intensity (or strength). The adjective “white” indicates that this 
noise has constant power at all frequencies. Any process that does not have equal 
power over the frequency interval is referred to as colored. 

The autocorrelation function of the white noise is determined as 

R v (t) = E[v(t)v(t + t)} = a 2 S(r) (C.28) 

where <5 is the Dirac delta function: <5(r) = lim £ ^ 0 8 s (r) and 

«,«4 s if w< * 

l 0 otherwise 

which has units of 1 /s. In the derivation of (C.28), one uses the relationship 


e J<OT dco = 8(z). 


White noise is completely unpredictable, as can be seen from (C.28) because it is 
uncorrelated for any r ^ 0, while it has finite variance and standard deviation at 
r = 0. According to (C.15), such process is physically unrealizable since it implies 
infinite average power. However, the white noise idealization is convenient to find 
approximate error models. Specifically, white noise is used to drive appropriate filters 
(called shaping filters) which produce finite power output over a particular frequency 
range. Thus, within the bandwidth of the shaping filter, the output of the filter is 
approximately equal to the noise of the system being modeled. 
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A white noise can have any probability distribution but the Gaussian distribution 
is often assumed. The notation v ~ N( 0,er 2 ) is used to describe a continuous-time, 
Gaussian, white noise v. In this case, er 2 is interpreted as the PSD, not variance. 

The units of the symbol er 2 may be determined in two different ways [85], First, 
from the PSD perspective, er 2 represents the power per unit frequency interval. There¬ 
fore, the units of er 2 are the units of v squared divided by the unit of frequency Hz. 
Second, from the perspective of correlation, R v has the units of v squared and the 
Dirac delta function <5(r) has units of Hz = 1/s. Therefore, er 2 has dimension cor¬ 
responding to the square of the units of v times s. For example, if v is an angle in 
degrees, then er 2 has dimension deg 2 s = deg 2 /(l/s) = deg 2 /Hz. The emits of er v are 
then either deg^s or deg/\/Hz. 

A discrete-time stochastic process v(k) is called white noise if 

S(jco) = ct 2 for all co e [— tt, tt] (C.29) 

According to the discrete Fourier transform, this implies that 

R v (k,j) = E { v(k)v(j) T } = (fyS/ k , (C.30) 

where 

m = | l ~f e Jke d9 
is the Kronecker delta function, defined as 
1 if k = 0 
0 otherwise. 

The Kronecker delta function 8(k ) is dimensionless. The dimension of a v is the same 
as the dimension of v(k). 

Contrary to the continuous-time case, the discrete-time noise is physically real¬ 
izable. Its power is finite, because the integral of the PSD is only over the discrete 
frequency range w e [-tv, tv]. 



C.4 Gauss-Markov processes 

If the input v(t) of a linear system 
x(t) = Ax(t) + Gv(t), 
y{t) = Cx(t) 

is a Gaussian stochastic process, then this system represents a Gauss-Markov process. 
Since any linear operation performed on a Gaussian RV results in a Gaussian RV, the 
system state x(t) and output y(f) will be Gaussian stochastic processes. In what follows 
we describe two Gauss-Markov processes which are frequently used in stochastic 
modeling. 
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One of the basic Gauss-Markov processes is the so-called random walk. The 
random walk is an output of an integrator driven by zero mean white noise. It is 
described by the following equation: 

d ^=w(t), (C.31) 

where E{w(t)} = Q,E{w(t)\v{t + r)} = o^S(t). It is possible to prove that 
E[x 2 (t)} = alt 

which shows that the variance of the random walk is growing linearly with the time. 
This process is suitable to model errors which grow without bound or are slowly 
varying. Since the transfer function of the integrator is 


the spectral density of the random walk is given by 
S x (co) = |GO>)| 2 4 = 

As with white noise, the emits of the random walk process may be determined in 
two different ways. For instance, if x is angular rate measured in deg/s, then E\x 2 (t)) 
has units of deg 2 /s 2 . Therefore, the units of a w are (deg/s)/^ or (deg/s 2 )/\/Hz. 

Another typical random process used in stochastic modeling is a first-order 
Gauss-Markov process described by the differential equation 

~ t ^ = - ^*(0 + w(t), (C.32) 

where w(t) is a white noise with strength er 2 . Clearly, the first-order Gauss-Markov 
process represents the output of a first-order lag 


G(s) = - 


1 


Ts + 1 

with time constant T, driven by a white noise. Using (C.18), one obtains that the 
spectral density of the first-order Gauss-Markov process is given by 

Using (C.13), it is possible to show that 

2 1 /" 1 2 j °w 

Using this relationship, the spectral density is represented as 

In this way, the autocorrelation function of x(t) is given by 
R(t) = ale~ woM , 
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where the parameter co 0 = 1 jT is called bandwidth and the time-constant T is called 
correlation time. 

Since the units of ct 2 are the units of x squared, it follows that a 2 has dimension 
corresponding to the units of x squared times s. If, for example, x has units of deg/s, 
then the units of rr vl are (deg/s),/s or (deg/s)/\/Hz. 

C.5 Generation of white noise in MATLAB® 

The generation of random sequences with normal distribution is done in MATLAB 
by the function randn. These sequences, after appropriate scaling, may be used to 
simulate approximately white noises with desired strengths. 

In Simulink®, one may use the Band-Limited White Noise block to produce 
discrete signals which approximate the effect of continuous white noise in a given 
frequency range. Specifically, for a given noise power (strength) <r c 2 and sample time 
T s , the Band-Limited White Noise block generates a noise with two-sided spectral 
density S equal to er? and correlation time equal to T s . The correlation time determines 
the frequency range in which the generated signal has constant PSD and hence may 
be considered as a white noise. Theoretically, the continuous-time white noise has 
correlation time equal to 0. In practice, it is recommended that the correlation time 
is sufficiently small and satisfies 

1 2 71 

T s <- 

c w B 

where cob is the bandwidth of the simulated system in rad/s and c > 100. Note that to 
produce the correct intensity of the noise, the covariance of the noise is scaled to reflect 
the implicit conversion from a continuous PSD to a discrete noise covariance. (The 
strengths of the discrete-time and continuous time noises, and a 2 , respectively, 
are related by erj = a^/T s .) This scaling ensures that the response of the simulated 
continuous system to the approximate white noise has the same covariance as the 
system would have to true white noise. Because of this scaling, the covariance of the 
signal from the Band-Limited White Noise block is not the same as the Noise power 
(strength) parameter. This parameter is actually the value of the two-sided PSD S of 
the white noise. This block approximates the covariance of white noise as rr 2 /T s . 
Example C.l. Generation of Band-Limited White Noise 

Assume that it is necessary to produce a Band-Limited White Noise with one-sided 
PSD equal to S 0 = 0.001 and correlation time 0.005 s. Since S 0 = 2S, this means that 
the noise power parameter and the sampling time of the Band-Limited White Noise 
block should be set as S = S a /2 and T s = 0.005 s, respectively. The simulation is 
done in Simulink for 1,000 s the noise being saved in the variable x. The one-sided 
spectral density of the noise is computed by the command lines 

window = 500; 
fs = 1/T_s; 

[Pxx,f] = pwelch(x.data,window, [],[],fs); 
semilogy(f,Pxx), grid 
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Frequency (Hz) 


Figure C.2 Spectral density of the band-limited white noise 


The one-sided spectral density of x is shown in Figure C.2. Clearly, the PSD of 
x is close to the prescribed value S a = 0.001 in the frequency range [0-100] FIz. The 
covariance of x is close to rr 2 = S/T s = 0.1. □ 

To produce a noise signal with desired spectral content, one can use Band-Limited 
White Noise and an appropriate shaping filter. 


C.6 Notes and references 

The theory of RVs and stochastic processes is presented in depth in Papoulis [203]; 
Maybeck [72]; Farrell [85, Chapter 4]; Hendricks, Jannerup, and Sorensen [45, 
Chapter 6], 
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Appendix D 

Identification of linear models 


An alternative approach for model building is plant identification. Identification 
means obtaining of system model based on experimental (measurement) input/output 
data. A model can be identified by two approaches named “black box” and “gray box,” 
respectively. The black-box approach requires only measurements of system inputs 
and outputs. The black-box models do not reveal explicitly the physical structure 
and parameters of the system, but they may be simple and appropriate for controller 
design. The gray-box approach except input/output measurements requires informa¬ 
tion about model structure. This approach is useful when we can derive model structure 
from physical principles but do not know the values of parameters, like mass, moment 
of inertia, friction coefficients. The main advantage of gray-box models is that their 
variables and parameters have physical interpretation and reveal explicitly physical 
relations between variables. 

The detailed systematic representation of various types of model structures and 
methods for their parameters estimation is out of scope of this appendix. Our aim is to 
introduce the reader into the practical aspects of identification process and to describe 
how to perform identification using the capabilities of MATLAB® and Simulink®. 
First, we shall briefly present identification of black-box models based on the most 
often used in practice model structures and methods for their parameters estimation. 
Next, we describe shortly the gray-box identification approach based on the linear 
state-space model. In Chapter 2, the black-box and gray-box approaches are imple¬ 
mented on the cart-pendulum system described in Example 2.1. In Chapter 7, the 
black-box approach is applied for identification of a real system—two-wheeled robot. 


D.l Identification of linear black-box model 

The identification process of linear black-box models includes following four stages: 

• Experiment design and input/output data acquisition 

• Model structure selection 

• Estimation of model parameters 

• Validation of estimated model to decide whether the model is adequate for the 
aims of controller design. 
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Figure D.l Black-box model identification procedure 


As there does not exists unique experiment design technique, unique model type, 
unique model structure, and unique parameter estimation methods which can guar¬ 
antee that the estimated model will pass validation tests, the identification procedure 
can be regarded as an iterative (trial and error) procedure illustrated in Figure D. 1. 

If the model obtained does not pass the validation tests, then the experiment 
conditions, selected model type and structure, and/or estimation algorithm should be 
reconsidered. Now we briefly present the essential components of each identification 
stage. 

D.1.1 Experiment design and input/output data acquisition 
The aim of this stage is to perform an experiment and to collect the input/output data. 
Good experiment design means that the collected data contains information about 
significant plant dynamics, measured variables are the right ones, and measurements 
are performed with sufficient accuracy for enough long time. In general in experiment 
we should 

• use input signals that excite enough plant dynamics, 

• measure data with appropriate sample time, 
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• measure data long enough to collect information about important time constant, 

• set up data acquisition system to have sufficient large signal-to-noise ratio. 

Input signals must have sufficiently rich spectrum which cover the bandwidth of 

identified system and in the same time must be small since in practice the magnitude 
of input signals is always constrained. For example, the step signal seldom excites 
system enough. Moreover, it deviates output signal from its steady state value for 
long time which is unacceptable in many practical cases. Good input signal used in 
identification experiment must be persistently exciting [48, Section 13.2]. 

Definition D.l A quasistationary signal u(t) with spectrum d>„(<y) is said to be 
persistently exciting of order n if for all filters of the form 

M„(z~ l ) = mi z~ l + m 2 z~ 2 + ■ ■ ■ + m„z~ n , (D.l) 

the relation |M„(e ; “)| 2 <I>„(a>) = 0 implies that M n (e ,m ) = 0. 

We also should note that \M n (e-' u: )\ <&„(«) is the spectrum of the signal v(t) = 
M„(z~ x )u(t). Hence, a signal that is persistently exciting of order n cannot be filtered 
to zero by (n — l)th-order moving-average filter. Another definition is given in terms 
of the autocorrelation function of the input signal R u (n). 


Definition D.2 The quasistationary input signal u(t) is persistently exciting of order 
n if the matrix 


R u ( 0) R u ( 1)... R u (n - 1) 
i?„(l) R u ( 0)... R u (n- 2) 

R u (n - 1) R u (n - 2) R u ( 0) 


(D.2) 


is nonsingular. Note that the order of persistent excitation of input signal equals to 
the number of parameters which one can estimate from dataset. 


Example D.l. Persistently exciting signal 

Let us consider the sinusoidal signal u(t) = sin (cot). It is easy to show that 


R u (m) = - cos (com) 
Then, we evaluate 

/I 


det(^) = det - cos(0) = - ^ 0 


det (R 2 ) = ^ det 
det (R 3 ) = - det 


1 cosw 
:oso> 1 


^0 

1 cos&> cos2« 

COS CO 1 COS CO 

cos2o> cos&> 1 


(D.3) 


(D.4) 

(D.5) 

(D.6) 


Therefore, the signal u(t) = sin (cot) is persistently exciting of order 2, which 
means that if a sinusoidal input is used, we can estimate model with two parameters. 
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The degree of input signal persistence of excitation in MATLAB environment is 
determined by function pexc i t from System Identification Toolbox™. It calculates 
the smallest rank of matrix (D.2). □ 


The primary aim of experiment design is to provide appropriate data for iden¬ 
tification which means that the experiment should be informative enough. We say 
that the identification experiment is informative enough if it generates dataset that 
is informative enough. This means that by dataset we can distinguish between two 
different models in intended model set [48, see Section 13.2], 

Theorem D.l Consider the set of SISO models S given by the rational transfer 
functions 


Wiz~ x ) 


b\z 1 + b 2 z 2 H-1- b nb z nb 

1 + a\z~ x + a 2 z~ 2 -h a na z~ m 


A(z- x y 


Then the open-loop experiment with an input that persistently exciting of order 
na + nb is informative with respect to S. 

Remark D.l An open-loop experiment is informative if the input signal is persis¬ 
tently exciting. The necessary order of persistent excitation is equal to the number of 
parameters to be estimated. 

Remark D.2 Persistently excitation of m-dimensional signal u(t) is defined analo¬ 
gously to Definition D.l. Let it be defined by (D.l) with m l as 1 x m row matrices. 
Then, one says that u(t) is persistently exciting of order n if 


M n (e J,0 )<t> u (oj)M b (e jal ) = 0, 


implies that M n (e J0J ) = 0. 

Note that Definition D.2 has a counterpart for the multivariable case too. 

All mentioned above impose requirements to the input signal. In case of linear 
model identification, the choice of input signal is governed by three basic facts (see 
[48, Section 13.3], [17, Section 3.2.2]): 


• The bias and variance of the estimate depend only on the input spectrum and not 
on the actual waveform of the input. 

• The input must have limited amplitude. 

• Periodic inputs may have certain advantages. 


It is well known that the estimates covariance matrix is inversely proportional to 
the input signal power. Thus, we would like to have as much power in the input as 
possible but in practice we have amplitude limitations. The desired property of input 
signal wave form is defined in terms of the crest factor, which for zero mean signal 
is defined as 


C] = 


max k u 2 (k) 

limy^ool /N J2 u 2 (k) 


(D.7) 
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The good signal waveform is one that has small crest factor. The theoretic lower 
bound of C;? is 1, which is achieved for symmetric binary signal u(k) = ±u. This 
gives advantage of binary signal. Indeed, in practice this type of input signal is often 
used. However, it should be mentioned that binary input will not allow validation 
against nonlinearities. 

In practice, it is suitable to decide upon a frequency band to identify the system 
in question and then select a signal with more or less flat spectrum over this band. 
A simple choice is to generate input signal as white Gaussian noise. This signal is 
theoretically unbounded, so it has to be saturated at certain amplitude. For example, 
picking it to three standard deviations gives a crest factor of 3, and in the same time, 
only average 1% of the points will be affected—this leads to minor distortion of the 
spectrum. 

Another commonly used choice of input signal is a random binary signal (RBS), 
which is obtained by the sign of the filtered white Gaussian noise. The level of 
this signal can be adjusted to any desired one so that the amplitude limitations of 
input signal to be satisfied. The crest factor will be equal to the ideal value 1. The 
problem is that taking the sign of the filtered Gaussian noise will change its spectrum. 
Therefore, we do not have full control of shaping the spectrum, but in the case of off¬ 
line identification, we can check the spectrum of RBS before using it as input to the 
identified system. Third commonly used input signal is pseudo-RBS (PRBS), which 
is deterministic periodic signal with like white noise properties. It is generated by the 
following equation: 

u(k ) = modulo a k u(k — i ), 2^ , (D.8) 

where a k are constants and function modulo (x, 2) is the reminder as x is divided 
by 2, thus u(k) only taking values 0 and 1. The vector of past inputs [u(k — 1), 
u(k — 2),..., u(k — n)] can assume 2" different values. The sequence u(k) therefore 
will be periodic with period of at most 2". In fact since n consecutive zeros will 
make further w’s zero, we can eliminate that state and the maximum period length 
is M = 2" - 1. The actual length of period depends on the choice of a k . It can be 
shown that for each n exists choice of a k which give maximum period length and the 
corresponding signals are called the maximum length PRBS. 

The interest in maximum length PRBS follows from the fact that any maximum 
length PRBS taking levels ±u has the so-called first- and second-order properties 




454 Design of embedded robust control systems using MATLAB® /Simulinkf 
where M is the maximum length of the period. The spectrum of PRBS is given by 

2 " 2 M_1 

d>„(a>) = n Y 8{co — 2nk/M), 

M “ 

where 0 < co < 2 tc and <5 is the Kronecker operator. This property shows that the 
maximum length PRB S behaves like “periodic white noise” and is persistently exciting 
of order M — 1. Like RBS PRBS has crest factor equal to 1. The advantages and 
disadvantages of PRBS compared to the binary random noise can be summarized as 
follows: 

• As deterministic signal PRBS has its second-order properties (second equation in 
(D.9)), when is evaluated over whole periods (for random signals must rely on the 
law of large numbers to have a good second order properties for finite samples), 

• There is essentially only one PBRS for each choice of a k . Different initial values 
when generating (D.8) only correspond to shifting the sequence. It is therefore 
not straightforward to generate mutually uncorrelated sequences of PRBS, 

• In order to have good properties of PRBS, an integer number of periods has to be 
considered, which limits the choice of experiment length, 

• The algorithm generating PRBS can be easily implemented by microcontroller. 

In MATLAB, the identification input signal can be created by the function 
idinput, which generates random Gaussian signal or RBS (by default), or PRBS, 
or sum of sinusoids. As a conclusion, it is always advisable after generation of input 
signal to study its properties offline before using it in identification experiment. 

Another important issue of experiment design is choosing of sample time for 
measuring data. As mentioned in Chapter 1, sampling the data leads to losses of 
information and it is important to select sampling instances so that these losses are 
negligible. Detail description of appropriate choosing of sample time in case of iden¬ 
tification is given in [48, Section 13.7], Here, we will present some practical advices 
for choosing of sample time. The model which is identified with small sample time 
fits data in high frequencies, where the measurement noise influence on the data may 
be significant. Moreover very small sample time, which is near to the smallest time 
constant, leads to the numerical problems according to that the model poles are near 
to the unit circle. Often such models have zeros outside of the unit circle. Then, if 
the estimated plant has time delay, it is modeled by large number of samples. Each of 
these effects causes problems in control design task. Large sample time leads to the 
losses of information about significant plant dynamics and the variance of estimated 
parameters increases drastically near to the smallest time constant. Again these effects 
cause problems in control design task. It is obvious that the choice of sample time is 
trade-off between the reduction of high frequency noise influence and capturing the 
plant dynamics. A good practical advice is to choose sampling frequency about ten 
times the bandwidth of the system under consideration. Another useful advice is first 
to record step response and then choose sample time 30^10 times smaller than rising 
time. 
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Figure D.2 Block diagram of SISO system model 


D.1.2 Model structure selection and parameters estimation 

The selection of appropriate model structure is crucial for a successful identification. 
To perform this choice, first we must estimate set of models and next evaluate in some 
manner the quality of each model. The model performance is assessed with various 
quality metrics, which provide a tool to pick the best model from given set. From 
control view of point, the best model means possibly simplest low-order model that 
explains input/output data “reasonably well.” The difference between the obtained 
model and actual plant output can be regarded as the response of the uncertain part 
of the plant. It can be used for determination of uncertainty model. Such models are 
used in controller design in the framework of robust control which is described in 
Chapter 4. There are various types of linear and nonlinear models, parametric and 
nonparametric models, discrete-time and continuous-time models. Here, we first will 
briefly present most often used in control practice linear time-invariant polynomial 
and state-space models and general methods for their parameters estimation. Second, 
we introduce some of quality metrics for model performance evaluation. 

The general description of SISO system in the time domain is presented in 
Figure D.2. It is a linear discrete-time invariant model with additive disturbance 

y(k)=G(q-\0) U (k) + v(k), 

v(k) = H(q-\0)e(k), 

where G(q~ l ,0) is a proper rational transfer function between output y{k) and input 
u(k), v(k) —additive output disturbance, H(q~\9) —a proper rational transfer func¬ 
tion which is used to modeling the noise, e(k) —zero mean white noise with covariance 
X, and 0 —vector with unknown model parameters, which must be estimated from 
experimental data. These estimates should be evaluated in such manner that the model 
be “good.” The model will be “good” if it predicts “well” the output, which means 
that it produces small prediction error 

e(k, 9) = y(k) - y(k/k -1,9), (D. 11) 

where y(k/k - 1, 9) is the predicted output value. This value is calculated based on 
input/output data to the moment k — 1. The question is how to qualify what is “small” 
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prediction error. Various metrics can be applied, but most often used cost function in 
practice and in MATLAB System Identification Toolbox is 

1 N 

J(O)=~Y,e 2 {k,0), (D.12) 

k= 1 

where N is the number of input/output measurements. The estimate § N of 9 is 
defined as 

9 n = arg min (J(6)). (D. 13) 


The estimates 0 N can be determined after calculation of one-step-ahead predicted 
output y(k/k — 1,0) and after parametrization of transfer functions in (D.10). The 
one-step-ahead predictor of output signal which minimizes mean square of prediction 
error is [48, Section 3.2] 

y(k/k - \,9) = ,e)G{q-\9)u{k) + [I - H~\q-\e)]y{k). (D.14) 


Equations (D.10)-(D.14) define the Prediction Error Method which is imple¬ 
mented in many functions of System Identification Toolbox. After parametrization 
of (D.10) with rational transfer functions, the parameters will be the coefficients in 
nominators and denominators of these transfer functions. Such models are also known 
as black-box polynomial models. 

One of the simplest relationships between output and input is given by 

y(k) + a t y(k - 1) + a 2 y(k - 2) H-b a na y(k - no) # 

b\u(k - 1) + b 2 u(k - 2) -|-b b nb u(k - nb) + e(k) 


Here, the white noise e(k) enters directly in the difference equation. After 
introducing the vector with unknown parameters 6, polynomials A(q~ x ), and ) as 

9 = [ai,a 2 , ... ,a„ a ,bi,b 2 ,.. .,b nb ] T , 

A(q~ l ) = 1 + a x q~ l + a 2 q~ 2 -|-b a m q~ na , (D.16) 

B(q~ l ) = b\q~ l + b 2 q~ 2 -|-b b nb q~” b , 


(D.15) takes the form 


1 


e(k). 


Equation (D.17) is a special case of (D.10) if 

G{q ~ l ’ e) = B fr-Tv H{q ~ l ’ 0) = 7TA- 

A{q~f A(q~ l ) 


(D.17) 


(D.18) 


The model (D.17) depicted in Figure D.3 is the so-called ARX model, because 
it comprises the autoregressive part (AR) A(q~ ] )y(k) and exogenous part (X) 
B(q~ l )u(k). In the special case of na = 0, the model (D.17) is transformed to the 
finite impulse response (FIR) model. The main disadvantage of ARX model is that 
the output disturbance is obtained from white noise e(k) which goes through the 



Identification of linear models 457 


Air 1 , e> 


Figure D.3 Structure diagram ofARX model 


denominator dynamics A(q ' ) of system. The main advantage is that the predictor 
(D. 14) defines linear regression. Indeed, let we introduce the regression vector <p(k) as 


<P(k) = [-y{k - 1), -y(k - 2),..., -y(k - no), 

u(k - 1), u(k -2u(k- nb)f. (D.19) 

After substitution of (D.18) into (D.14) and taking into account (D.16), (D.19), the 
predictor (D. 14) based on ARX model takes the form 

yfk/k -1,0) = V T (k)0. (D.20) 

The predictor output is formed by scalar product of the known regression vector and 
the parameter vector. From (D.20) and (D. 11), we obtain 

y(k) = cp T (k)0+e(k). (D.21) 

Equation (D.21) defines linear regression model whose parameters are determined 
by simple estimation method, such as linear least square. According to (D.20) and 
(D.21), the prediction error (D.l 1) becomes 

e{k,0)=y(k)-<p T (k)0. (D.22) 

Thus, the cost function (D.l2) for linear regression model (D.21) is 

m = jj E ( y ( v - <p T im 2 , ( d . 23 ) 


which is known as least square criterion for linear regression model. The cost func¬ 
tion (D.23) is a quadratic function in 0 and can be minimized analytically, which gives 
the least square estimate 

f i * 1 _1 i * 

0 = arg min J(0) m I — ^ <p(k)(p T (k) I — ^ <p(k)y(k). (D.24) 

It is important to note that the estimate has unique solution if the matrix 

R § (N) = ^J2 ( P( k ) ( P T (k) 


(D.25) 
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is nonsingular, which is provided by the informative identification experiment. 
Substituting (D.21) in (D.24), the bias M{9} - 9 of least square estimate is calculated 
from 

M{9} -9 = M J |^i J2 *>(*)p r (*)J i 

= Jf 

= M^R7\N)^J2v(k)e(k)^. 

The estimate 9 will be unbiased if (D.26) is equal to zero. It can be shown that if 
the process e(k) is a sequence of independent random variables with zero mean (white 
noise), than the least square estimate will be unbiased. Now, let consider constraints 
for output disturbance imposed by the requirement for unbiased estimation in case of 
ARX model. Assume that the actual plant output is formed by 

y(k ] = ^udc) + v(k), (D.27) 

and we model plant dynamic by ARX model (D.17). Then after substituting (D.27) in 
(D.17), one obtains 

e(k) = A(q~ 1 )v(k). (D.28) 

It is seen from (D.28) that the process e(k ) will be white noise if the plant output 
disturbance v(k ) is formed by 

^ = A^)^ (D ' 29) 

where rj(k) is a zero mean white noise. Equation (D.29) imposed requirement for 
output disturbance which is not realistic from practical point of view. 

The least square method applied to the linear regression model has many advan¬ 
tages, such as simplicity of ARX model and achievement of global minima of (D.23). 
Its main shortcoming is the restriction (D.29). If the plant output disturbance cannot 
be modeled in accordance with (D.29), then the estimated coefficients will not be 
equal to the true ones. Nevertheless, the least square method for estimation of ARX 
model is one of the most used in control practice identification method because of 
its simplicity and due to the fact that in many cases the bias of estimates is small 
provided of small noise power. 

The main disadvantage of the ARX model (D. 15) is the lack of adequate freedom 
in describing the output disturbance in (D.10). We can introduce more flexibility to 


v0i)(V T (k)9 + e(k)) j - 9 
^q>(k)e(k\ 
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that by describing the output disturbance as a moving average of white noise. This 
gives the so-called ARMAX model 

y(k) + a x y{k - 1) + a 2 y(k - 2) +-h a na y(k - no) 

= b\u(k - 1) + b 2 u(k - 2) -|-1- b nb u(k - nb ) + e(k) 

+ cie(k — 1) H- + c„ c e{k - nc ). (D.30) 


(D.31) 

. It is clear that (D.31) corre- 


(D.32) 


Equation (D.30) can be rewritten as 
A{q-')y(k) = B( q -')u(k) + C(q-')e(k), 

where C(q~ l ) = 1 + c x q~ x + c 2 q~ 2 H-h c nc 

sponds to the description (D.10) with 

A(q ') A(q ') 

The vector with unknown parameters will be 

9 = [a\,a 2 ,... ,a na ,b\,b 2 ,.. .,b nb ,c\,c 2 ,... ,c„ c ] T . 

The predictor for ARMAX model is obtained by inserting (D.32) in (D.14), 


C{q- x )y{k/k -1,0) = B(q~ x )u(k) + [C(q~ x ) - A{q~ x )\y{k). (D.33) 

Adding (1 - C(q~ x ))y(k/k - 1, 0) to the both sides of (D.33), we obtain 
y(k/k - 1,0) = B(q~ x )u(k) + [1 - A(q~ x )]y(k ) 

+ [C(q ') - 1 ]\y(k)~Kk/k - 1,0)]. 

Introducing the vector 

<p(k, 0) = [— y(k — 1), — y(k — 2),..., — y(k — na), u(k — 1), 

u(k — 2), ..., u{k — nb), e(k — 1,0), e(k — 2,0),..., e(k — nc, 0)] r 


and taking into account (D.22), the predictor can be rewritten as 

y(k/k - 1,0) = <p T (k,0)0. (D.35) 


From (D.l 1) and (D.35), we obtain 

y(k) = <p T (k, 0)0 + e(k, 0). (D.36) 


Equation (D.36) is similar to the linear regression model (D.21), but it is not linear in 
0 due to the dependence of vector cp on parameters 0. The model (D.36) is known as 
pseudolinear regression. The ARX and ARMAX models are special cases of general 
polynomial model 


A(q-')y(k)= 1 ^^u(k)l 


C(q~ X ) 


elk.). 


(D.37) 
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This model may give rise to 32 different model sets, depending on which of five 
polynomials A, B, C, D, and F are used. Very often in practice the dynamics from 
input u to output y has delay of nk samples, so some of the leading coefficients of 
B(q~ x ) are zero, that is 

B(q~ x ) = b„ k q~ nk + b nk+l q~ nk ~ x A -f b nk+nb -iq~” k ~" b+l = q~ nk B(q~ l ). 


Then, the general model can be rewritten 

. B{q~ X ) - n > 


A{q )y(k) = ~v 

F(q ') 

The predictor for model (D.38) is 


^(k). 

D(q~f 


y(k/k-l,9) = 


D(q- l )B(q- 1 ) _ nk 


C(q-fF(q-') 
If we introduce the vectors 


q nk u(k) + 1 - 


D(q~ 1 )A(q~ l y 

C(q ~ l ) . 


y(k). (D.39) 


6 = [a u ..., a m , b nk ,..., b„ k+nb - U f,... ,f„f,c u ..., c„ c , d u ..., d nd , f, 


(p{k, 0) — \—y(k — 1),..., —y(k — na), u(k — nk ),..., u(k — nk + nb + 1), 


— w(k — 1,0),..., — w(k — nf,B),e(k — 1,6),... ,e{k — nc,6), 

-v(k- l,9),...,-v(k-nd,6)] T , (D.40) 

where 

Mk, 9) = B( i' )qnk u(k), v(k, 9) = A(q-')y(k) - w(k, 9), e(k, 9) = \v(k, 9), 
F(q ') C(q ') 

it can be shown that the predictor (D.39) takes the form (D.35). The pseudolinear 
regression in the general case of model (D.38) has the form 

y {k) = (p T (k, 9)9 + e(k, 9), (D.41) 

where 9 and cp T (k, 9) are formed by (D.40). The structure (D.38) is too general for most 
practical purposes. It is simplified by fixing to unity of one or several of polynomials 
A, B, C, D, and F. Some of the commonly used black-box models, which are special 
case of (D.38), are summarized in Table D.l. 

In case of pseudolinear regression (D.41), the cost function (D.12) is not linear 
in 9 and cannot be minimized by analytical methods. The solution should be found 


Table D. 1 Some common black-box models 


Polynomials used Name of the model structure 


B(q- 1 ) 

A(q-'),B(q~') 

A(q-'),B(q-'),C(q- 1 ) 

B{q-'),F{q-') 

B(q~ l ),F(q~ l ), C(q~ x ),D(q~ l ) 


FIR (finite impulse response) 

ARX 

ARMAX 

OE (output error) 

BJ (Box-Jenkins) 
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by iterative numerical procedures [48, Section 10.2], The methods for numerical 
minimization of J(6) update the estimate 9 by the following equation: 

<?(' +1 > = e® + a/®, (D.42) 

where /® is the search direction based on the information about J(6) acquired on 
the previous iterations and a is a positive constant determined so that an appropriate 
decrease in value of J(9) is obtained. Depending on the information supplied by the 
user to determine /®, numerical minimization methods can be divided into three 
groups: 

• methods using only values of J(6), 

• methods using values of J(9) as well as its gradient, 

• methods using values of J(9), its gradient and its Hessian matrix. 


The typical member of third group corresponds to Newton algorithms, where the 
search direction is obtained as 


/® = -[/(0®)rV(0®>, (D.43) 

where J{9 ®) and j"(6 t,] ) are the gradient and the Hessian matrix of loss function 
calculated with the estimates from previous iteration. 

The important subclass of second group is quasi-Newton methods which are used 
to estimate the Hessian in order to form innovation term in accordance with (D.42). 
Algorithms of first group either form gradient estimates by difference approximation 
and then proceed as quasi-Newton methods or have other specific search patterns. 

In MATLAB, the prediction error method is implemented in several functions 
of System Identification Toolbox such as armax, b j, and pem. The user can select 
search method for minimization of(D.12) between Gauss-Newton [48, Section 10.2], 
adaptive Gauss-Newton [204], lasqnonlin [205], Levenberg-Marquardt, and 
steepest gradient algorithm [48, Section 10.2], By default search method option is 
auto which means that the descent direction is calculated using successively each of 
above mentioned algorithms at each iteration. The iterations continue until a sufficient 
reduction of error is achieved. 

Analogously to (D.10), the general description of MIMO system is obtained as 


y(k) = G(q-\e)u(k) + v(k), 
v(k) = H(q~ 1 ,G)e(k), 


(D.44) 


where the input u(k ) is an m-dimensional vector, the output y(k) is p-dimensional 
vector, the additive output disturbance v(k) is p-dimensional vector, G(q~ l ,9) and 
H{q~ x ,9) are proper rational transfer matrices and the p-dimensional vector e{k) is 
zero mean white noise with covariance matrix A and 9 is vector with unknown model 
parameters, which must be estimated from experimental data. The estimate 9 N is 
obtained by (D.13) where the cost function takes the form 


■m= ] N J2 eT ( k ^ k ^ 


(D.45) 
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The /^-dimensional prediction error is calculated by the following equation: 

e(k, 9) = y(k) - y{k/k -1,0), (D.46) 

where y(k/k - 1,0) is a /^-dimensional vector with one-step-ahead predicted out¬ 
puts. The estimates are determined after parametrization of (D.44) and calculation 
of y(k/k - 1,0). The one-step-ahead predictor can be easily generalized for MIMO 
case after parametrization of (D.44). Most of the regarded SISO polynomial models 
can be generalized for MIMO systems. The simplest case is a generalization of ARX 
model (D.15): 

y(k) + A x y(k - 1) + A 2 y(k - 2) + -f A„ a y(k - no) = B lU (k - 1) 

+ B 2 u(k - 2) H-f B„ b u(k - nb ) + e(k), 


where A t are pyp matrices and B, are p x m matrices. The element of of matrix A,- 
gives the relation between the current value of the y'th output y,(k) and the delay by 
/-samples value of 5th output y s (k — /). The corresponding element if of the matrix 
B t gives the relation between the current value of the y'th output »(&) and the delay by 
/-samples value of 5th input u s (k — /). After introducing the matrix polynomials 


A(q *) = / + A\q l +A 2 q 2 -\ -b A na q na , 

B(q~ x ) = B iq ~ l + B 2 q~ 2 + • • • + B nb q~ nb , 


(D.48) 


the MIMO ARX model can be rewritten as 


A(q-fy(k) = B(q-')u(k) + e (k\ 


(D.49) 


which is a special case of the MIMO model (D.44), where G{q~ x ,0) = 
A~ l (q~ l )B{q~ l ) and H(q~ x ,9 ) = A~ 1 (q~ l ). The inverse A~ x (q~ l ) of matrix polyno¬ 
mial is calculated in straightforward way, due to the fact that G(q~ l ,6) is a p x m 
matrix, whose yth element is a rational transfer function from input Uj to outputy,. The 
very important issue in MIMO case is parametrization of (D.47). This means which 
elements of matrices in (D.47) should be included in parameters 6. Ifwe include all ele¬ 
ments of matrices and define the [na.p + nb.m ] x p matrix with unknown parameters 
9 and [ na.p + nb.m\ dimensional regression vector q>{k) as 

■ -y(k - 1) ' 

9 = [A u A 2 ,...,A na ,B u B 2 ,...,B nb ] T ,<p(k)= , (D.50) 

u(k — nb) 

according to (D.14), the predicted output is obtained as 


y{k/k-\,9) = 9 T (p(k). 


(D.51) 


Then, the MIMO analogue of linear regression model is 
y(k) = 9 T (p(k) + e(k). 


(D.52) 
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The cost function (D.45) becomes 

J (0) = ^ E 0<*) - 0 T <p(k)) T (y(k) - 0 T (p(k)), 
with the estimate 

On = ^ E ^ E V(k)/(k). (D.53) 

Equation (D.52) can be regarded as p different linear regressions written on top of 
each other. Each of them uses the same regression vector. When additional structure 
is imposed by parametrization we cannot use model (D.52), since the different outputs 
will not employ the identical regression vectors. Then, the (/-dimensional vector 9' 
with unknown parameters and a p x d matrix (p ,T (k ) must be formed so to represent 
the MIMO ARX model as 

y(k) = <p' T (k)0' + e(k), (D.54) 

with 


9' = col (9) = 


,(p'{k) = <p(k) g> I p , 


where 9‘ is the z'th column of matrix 9, I p is the />-dimensional identity matrix and 
symbol <g> means the Kronecker product. For a regression model (D.54) the cost 
function (D.45) becomes 

J (0) = jjT, (yik) ~ v' T (k)9')(y(k) - V ' T (k)6'), (D.55) 

with estimate 

^'(^V r (^)j ^ E v'i^yik). (D.56) 

As can be seen from expressions (D.53) and (D.56), if we use the parametrization 
(D.51), then to determine the estimates it is sufficient to invert a [na.p + nb.m] x 
[na.p + nb.m ] dimensional matrix, since to determine the parameters of model (D.54) 
we should invert a [na.p + nb.m].p x [na.p + nb.m].p dimensional matrix. 

The MIMO analogue of ARMAX model is 

y(k ) + Axyfk - 1) + A2y(k - 2) H-b A na y(k - na) 

= B\u(k - 1) + B 2 u{k - 2) + • ■ ■ + B nb u(k - nb ) + C ie (k - 1) 

+ C 2 e(k — 2) + • • • + C nc e(k — nc), (D.57) 
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which is a special case of model (D.44) for G{q~ l ,9) = A~ x {q~ l )B{q~ x ) and 

H(q~\e ) = A \q ')C(q '). 

If we choose G(q~ 1 ,9) = F~ l (q~ l )B(q~ l ) and 

H{q-\e) = D-\q- l )C{q~ l ), 

then the MIMO analogue of Box-Jenkins (BJ) model will be obtained. After 
parametrization of MIMO ARMAX and BJ models, the parameter’s estimates can 
be calculated by prediction error method. In MATLAB, the prediction error method 
in case of MIMO black-box polynomial models is implemented in the same functions 
as in SISO case. This means that the user can use functions arx, pem, armax, b j, 
oe for estimation of MIMO models. As we mentioned above, the parametrization of 
MIMO models is important issue which is out of scope of this book and we refer the 
reader to the references given in the end of the appendix where this topic is described 
in sufficient details. 

As an alternative to (D.10), the relationship between output, input, and noise 
signals can be written in form of discrete-time linear state-space model 

x(k + 1) = A d (6)x(k) + B d (9)u(k) + q(k), 

y{k) = C(G)x(k) + m, ( > 

where y(k ) is a ^-dimensional output vector, u(k) is m-dimensional input vector, 
x(k) is ^-dimensional state vector, q(k) is process noise acting on the states, £(&) is 
measurement noise. Significant advantage of state-space model in comparison with 
polynomial models is that we have to specify only the order n. In (D.58), q(k) and 
t;(k ) are assumed to be independent random variables with zero mean values and 
covariances: 

E {q{k)q T (k)) = = Rf9),E {q(k)k T (k)} = R,f9). 

9 is a vector that parameterizes the model, including unknown coefficients in system 
matrices and noise covariances. All elements of model (D.58) can be free or the model 
can have some specific structure with few parameters in vector 9 if we have some a 
priori information about physical meaning of states and noises. The assumption that 
the noises are white is not always realistic. In cases of colored noises, the state-space 
model (D.58) can be used after extra modeling and extension of state vector with 
additional states. Analogously to the input-output model (D.10), we have to estimate 
parameters 9 from input/output data in such manner that the model (D.58) predicts 
well the output (model produces small prediction error). The predicted output y( k, 9) 
for state-space model with Gaussian noises is calculated by the Kalman filter: 

x(k+l,9) = A d (9)x(k,9) + B d (9)u(k) + K(9)(y(k) - C(9)x(k,9)) 

y(k,9) = C(9)x(k,9) ’ [ > 

where x(k, 9) is the predicted value of the state vector at time instant k. The matrix 
gain K(9) is obtained from system matrices and noise covariances by 

K(9 ) = [ A d (0)P(9)C T (0) + R^(9)][C(9)P(0 )C t (0 ) + R^9)]~ l , 


(D.60) 
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where P(9) is evaluated as the positive semidefinite solution of the discrete-time 
Riccati equation: 

P(6) = A d (9)P(9)C T (9) + R,(G) - [A d (0)P(d)C T (9) + *„ f (0)] 

X [C(e)P(6)c T (0) + R^e)]- l [A d (e)P(e)c T (e) + R v( m T ' 

The predicted output thus can be formed by the filter 
KK0) = C(9)[ql - A d (0) + K(6)C(6)]-'B d (0)u(k) 

+ C(9)[ql - A d (9) + K(9)C(9)]-'K(9)y(k). 

The positive semidefinite matrix P(9) is the covariance matrix of the state 
estimate error 


P(9) = M \(x(k) - x(k, 9))(x(k) - x(k,9)f \. 

(D.63) 

Denoting the output prediction error as 


e(k)=y(k)-y(k,9), 

(D.64) 

the state-space model (D.58) can be rewritten as 


x(k + 1) = A d (9)x(k) + B d (6)u(k) + K(9)e(k) 

(D.65) 

y(k) = C(9)x(k) + e(k). 


This simpler representation is the innovation form of the state-space model and 
has only one disturbance source e(k). Note that both (D.65) and (D.58) lead to the 
same predictor model (D.59). Equation (D.65) can be regarded as special case of 
general model (D.10) if 

W(q~\9) = C(9)[ql — A d (9) + K(9)C(9)]~ l B d (9), 

(D.66) 

H(q-\9) = C(9)[ql - A d (9) + K(9)C(9)Y'K(9). 

The parameters of model (D.65) are estimated by minimization of cost function 
(D.45) with prediction error (D.64) and predictor (D.59). This minimization is per¬ 
formed by the same iterative algorithms as ones used in case of polynomial models. In 
MATLAIJ the estimation of state-space model in innovation form by the PEM method 
is performed by System Identification Toolbox function s s es t. The parameters may 
be obtained after parametrization of state-space model, which can be performed in 
various manners depending on a priori information. When we do not have knowledge 
about internal structure of model, the free parametrization is appropriate to use. Then 
any elements of matrices A d ,B d , C,K are adjustable by estimation procedure. The 
algorithm chooses the state variables basis automatically to obtain well-conditioned 
calculations and state variables do not have physical meanings. The second possibil¬ 
ity is to use canonical parametrization. It represents the state-space model in form 
with reduced number of parameters since many elements of matrices A d , B d ,C,K are 
fixed to zeros and ones. MATLAB function ssest supports three types of canon¬ 
ical parameterizations: companion form—the characteristic polynomial appears in 
right most column of matrix A d [48, Section 4.3, Example 4.2]; modal decomposition 
form—the A d matrix is block diagonal with each block corresponding to a cluster 



466 Design of embedded robust control systems using MA TLA B^'/Simulin/d' 

with nearby modes [173]; observable canonical form—the free parameters appear 
only in the selected rows of A d matrix, in B d and K matrices [48, Appendix 4.A], 
In case of canonical parametrization, the state variables and parameters again do not 
have physical meanings. The third possibility is to use structured parametrization, in 
which we exclude specific parameters from estimation procedure by setting them to 
specific values. This parametrization is useful when we have knowledge for structure 
of the state-space model, for example, if it is obtained from physical laws. 

Alternatively to the PEM method, the parameters of state-space model (D.65) can 
be estimated by noniterative methods such as the subspace methods. The subspace 
approach gives very useful algorithms for state-space model estimation which are 
particularly appropriate for MIMO systems identification. These algorithms allow 
numerically very reliable implementations and produce models with good quality. If 
desired, the model quality may be improved by using the obtained model as initial 
estimate for PEM methods. Detailed description of subspace approach can be found 
in [48,206,207]. The family of subspace methods for estimation of the state-space 
model presented in innovation form is implemented in MATLAB System Identifica¬ 
tion Toolbox function n4sid . It gives possibility to choose the weighting scheme 
for singular value decomposition among MOESP algorithm, canonical variable algo¬ 
rithm, and SSARX—a subspace identification method that uses an ARX estimation 
based algorithm to compute the weighting matrices. Using an SSARX weighting 
scheme allows obtaining unbiased estimates when using data from closed-loop exper¬ 
iment [49]. The maximum prediction horizon and the number of past inputs and past 
outputs that are used in prediction also can be defined by user or can be chosen by 
algorithm on the basis of the Akaike information criterion. 

After presenting the basic linear models and commonly used methods for 
their parameters estimation, we may continue with the next issue in identification 
procedure—model structure selection. This task involves following steps: 

• Choosing the type of model, which in generally involves selection between linear 
and nonlinear models, between black-box state-space or polynomial models and 
structure parameterized state-space model, 

• Choosing a number of candidate models in model set, which involves selection 
of possible orders of state-space model and possible degrees of polynomials in 
black-box polynomial models, 

• Estimating the model performance by some quality metrics and choosing the best 
model in set of candidate models. 

Note that the best model from given candidate model set may not describe suf¬ 
ficiently “well” plant dynamics; then the designer must redefine the set of candidate 
model (this can be done by increasing model order or by using candidate models with 
more complex structure). 

Choice of the model type depends on priori knowledge for identified system. 
If we have such information, it is reasonable to incorporate it in model structure 
(e.g., we may choose structure parameterized state-space model). In lack of any prior 
information, it is advisable to use different type black-box models. It is well known that 
to reduce the bias of estimates a model with more parameters should be used, but the 
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variance of estimates is increased with increasing the parameter numbers. Thus, the 
best model structure is trade-off between flexibility and parsimony of the model. The 
general advice for choice of model types in model set is “first try simple model,” 
which means that one should go into sophisticated model structure only if the simple 
ones do not pass the validation tests. Usually, identification procedure begins with 
estimation of impulse-response and frequency-response models from input/output 
data to gain insight into system dynamic. For example, from impulse response model, 
the assumption for value of time delay can be done, and from frequency response, 
the assumption for model order can be made. Then, the set of ARX or state-space 
models is formed. These models are sufficiently simple because they have few design 
parameters (for state-space model only the order n should be chosen and for ARX 
model the polynomial degrees na and nb should be chosen). Also, their parameters 
are estimated by fast noniterative methods, which provide easy estimation of large 
number of models of various orders. Selection of best model is performed on the basis 
of model quality metrics. Obvious quality metrics is the mean square error: 

m=^fle\k,e), (D.67) 

where e(k, 0) = y(k) - (p T (k)0 is the residual calculation for the estimated model. 
Thus, the best model in the given model set will be the one that produces smallest 
value of (D.67). The significant disadvantage of index (D.67) is that it takes into 
account only the fit between measured and model outputs and does not take into 
account model order. As a result, the loss function decreases with increasing model 
order. It continues to decrease after a correct model structure has been reached because 
the additional parameters adjust themselves to features of the particular realization of 
the noise. This is known as overfit in model, and this extra fit has no significance to 
us since the estimated model will apply to data with different noise realization. The 
effect of over fitting can be overcome by modifying quality metrics. The modification 
is done by introducing additional penalty term in (D.67). This term should increase 
the value of metrics when overfitting is occurred. The most common modified quality 
metrics are 


Akaike’s Information Criterion (AIC): 

= ln (J)+^r,N»d 
N 

where d is the number of estimated parameters. 

Rissanen’s Minimum Description Length (MDL) criterion: 

2 )- 


Akaike’s final prediction error 
FPE = det ( 


, T \ / 1 + dim 0/A \ 
J\l- dim 9/Nj ' 


(D.68) 


(D.69) 


(D.70) 
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The obtained model order by AIC is good compromise between model complexity 
and data fitting, while the leading aim of MDL criteria is to obtain the lower order 
model. In MATLAB, the best model among given ARX model set according to (D.67) 
or (D.68) or (D.69) may be determined by System Identification Toolbox function 
selstruc. Before using function s els true, user forms the model set by function 
struc and evaluates loss function (D.67) by function arxstruc. 

The best state-space model among given model set is commonly determined by 
the Hankel singular values of model (see Section 3.5), which measure the contribution 
of each state to the input/output behavior. Hankel singular values are to the model 
order what singular values are to matrix rank. In particular, small Hankel singular 
values determine states that can be discarded to simplify the model. In MATLAB, the 
best state-space model among given set may be determined by System Identification 
Toolbox function n4sid which plots the Hankel singular values of models. 

After choosing the best model in given model set, we must not forget that this 
model is the best among the finite number of models with specific structure, and it 
may not explain well system dynamics. Due to that we should perform validation of 
obtained model. 

D. 1.3 Model validation 

As a result of the parameter estimation procedure, the “best” model from given model 
set is obtained. The general question then is whether this “best” model is “good” 
enough. This question has several aspects such as 

• Does the model agree sufficiently well with the measure data? 

• Is the model good enough for our purpose? 

The first question means whether there is a functional closeness between the model 
and identified system. The second one means whether the obtained model can be 
used for aim which induces the modeling process. The ultimate validation then is 
to test whether this aim may be achieved using obtained model. For example, when 
model is used for controller design, then it will be “valid” if the controller provides 
control system performance. However, it is impossible, dangerous, or costly to test 
all possible models in real world. Instead, various tests for model validation are used. 

Note that for tests which compare model outputs to measured one and perform 
residual analysis, two types of dataset must be used: one for estimating the models 
(estimation data) and other for validating the models (validation data). If the same 
dataset is used for estimating and validating the model, there is a risk to overfitting 
data. When model validation process uses independent dataset, this process is called 
crossvalidation. 

D.l.3.1 Test consistency of model input-output behavior 

For black-box models, our interest is focused on their input-output properties. These 
are displayed in time domain by transient responses while in frequency domain—by 
frequency responses. Impulse and step responses plots help us to validate how well 
a model captures the dynamics. For example, we can estimate an impulse or step 
response from the data using correlation analysis (nonparametric model) and then 
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compare the correlation analysis result with transient responses of the parametric 
models. Because nonparametric and parametric models are derived using different 
algorithms, agreement between these models increases confidence in the parametric 
model results. It is always a good practice to display transient response of estimated 
model with confidence interval, which is obtained from variances of estimated param¬ 
eters. The confidence interval corresponds to the range of response values with a 
specific probability of being the actual response of the system. If we assume that the 
estimates have a Gaussian distribution, then the 99% confidence interval corresponds 
to 2.58 standard deviations. 

The frequency response plots help us to validate how well a model captures 
the dynamics in wide frequency range, which is their main advantage against time 
response. Analogously, we can estimate a frequency response from the data using 
spectral analysis (nonparametric model) and then compare the spectral analysis result 
with frequency response of estimated parametric models. The frequency response 
agreement between these models increases confidence in the parametric model results. 
Again we can display frequency response of estimated model with confidence interval. 
If we choose the estimated model to be a nominal one and transform the confi¬ 
dence interval into model uncertainty, then a model with unstructured uncertainty is 
obtained. This uncertainty model plays very important role in framework of robust 
controller design. 

Note that the comparison between frequency and time responses of nonparametric 
models and parametric ones should not be used in presence of feedback (closed-loop 
identification procedure) because feedback makes nonparametric models unreliable. 

D.l.3.2 Test of output signals 

This test checks the model’s ability to reproduce measured data by comparison of 
predicted or simulated model output with measured one. This comparison is made by 
plotting together the measured and predicted or simulated signals and by calculating 
some numerical fit. The most used numerical fit is 

ifi-ylLX 

- _ 2 x 100, (D.71) 

\\y-yh ) 

where y is a model output andy is a mean value ofy. Notice that 100% corresponds 
to a perfect fit, and 0% indicates that the fit is no better than guessing the output 
to be a constant (y = y). The negative fit is worse than 0% and can occur for the 
following reasons: the estimation algorithm failed to converge; the minimization of 
one-step-ahead prediction is performed during the estimation but in validation the 
simulated output is used; the validation dataset was not preprocessed in the same way 
as the estimation data. 

The plot of measured output and predicted or simulated output shows what 
features the model is capable to reproduce and what feature is not capture. The dis¬ 
crepancies can be due to noise or model errors but we see the combined effects of 
these sources. 
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D.l.3.3 Test of parameters confidence interval 

This test checks whether the estimated models have too many parameters. Checking 
is made by comparison of estimated parameters with their standard deviations. If 
confidence interval contains zero, this is indication for too large model order. The 
model order should be reconsidered and we can try to estimate reduced order model. 
If the estimated standard deviations are all large, this is again indication of too large 
model order. 

D.l.3.4 Pole zero test 

This test checks whether we may reduce the order of estimated model. The model 
poles and zeros with their confidence intervals are plotted. When confidence intervals 
of a pole-zero pair overlap, this overlap indicates a possible pole-zero cancelation. 
Then, we try to estimate lower order model. The obtained low-order model should 
be validated by test of output signal and test of residuals. If the plot indicates pole- 
zero cancelations, but reducing model order degrades the fit, then the extra poles 
probably describe noise. In this case, a different model structure that decouples system 
dynamics and noise should be chosen. For example, ARMAX, OE, or BJ model 
structures with an A or F polynomial of an order equal to that of the number of 
uncanceled poles can be tried. 

D.l.3.5 Test of residuals 

The difference between measured output and estimated model output is called 
residual. 

e(k)=y(k)-y(k,§). (D.72) 

It is clear that the residuals carry information about the quality of model. If we 
calculate some basic statistics as 

e max = max \e(k)\ ,e= i £ e\k), (D.73) 

the intuitive interpretation of (D.73) would then be like this “The model never produce 
the larger residual than e max and an average error larger than e, for all the data we 
have seen.” It is likely that such a bound will hold also for “future data.” The value of 
(D.73) will be limited if the residuals do not depend on particular input signal used in 
input-output dataset, since the model should work for a range of possible inputs. To 
check this, it is reasonably to study the covariance between residuals and past inputs: 

Reu(T) = ^ E < k > (k ~ T )' (°- 74 ) 

If this number is small, we have some reasons to believe that (D.73) have relevance 
when the model is applied to other inputs. Another explanation of importance R eu (j) 
to be small is as follows: if dependence between residuals and past inputs exists, then 
there is some part of output signal which originates from input signal, but it is not 
captured correctly by the model. This means that the model could be improved. 
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Similarly, if we find that the autocorrelation of residuals 
1 N 

Ur)=-J^e(k)e(k-r) (D.75) 

is small that is indication of good model estimate. Indeed, it is well known that 
to obtain unbiased model estimates the residuals should be zero mean white noise. 
Moreover, if values of (D.75) are not small means that some part of e(k) can be 
predicted from past data. Thus, we have again some dynamics that is not predicted 
by output and model can be improved. 

The simple way to check the correlation between residuals and past inputs is to 
investigate whether R eu ( r), k = 1,2,..., M is normally distributed with zero mean 
and variance 

Peu= E RfWuik), 

k=—M 

R e (r) =|E e(k)e(k - r), r = 0,1,2,..., M, 25 < M < N - dim 9, (D.76) 

R u (t) = k N J2 u(k)u(k- t),t = 0, 1,2,...,M, 25 < M < N — dim#. 

k= 1 

This is equivalent with probability of 99% to 


Reu(r) 

A(O)iUO) 


2,58 

~N~ ,Z 


1,2,....M. 


(D.77) 


If (D.77) is not hold, then the hypothesis that e(k) and u(k — r) are independent should 
be rejected. 

Similarly, the simple way to check the correlation of residuals with themselves 
is to investigate whether the normalized correlation function R e (r) /7? e (0) is normally 
distributed, which is equivalent with probability of 99% to 


Re(r) 

R e( 0) 


2.58 
N ,X 


1,2,..., A/. 


(D.78) 


If (D.78) does not hold, then the hypothesis that residuals are “white” should be 
rejected. 

The test checked the dependence between residuals and past inputs is called inde¬ 
pendence test and the test checked autocorrelation of residuals is called whiteness test. 
Passing the whiteness test means that the obtained parameters estimate is unbiased, 
model is functionally close to identified system and the estimated noise model is 
good. Passing the independence test means that the model captures whole signifi¬ 
cant input-output dynamics. In MATLAB, these tests are performed with function 
resid. It plots the autocorrelation functions of residuals and crosscorrelation func¬ 
tion between residuals and inputs along with the 99% confidence limits which are the 
expressions in the right side of (D.77) and (D.78). Such plot gives better insight on the 
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correctness of model structure. For example, if the identified system has time delay 
of one sample but we assume in model time delay of two samples, then correlation 
between u(k — 1) and e(k) can be seen. 

Another version of independence test is to estimate dynamics between residuals 
and inputs which means to estimate model of model error. Then the model’s frequency 
response plot along the confidence regions will give picture of what frequency range 
the model has not captured the system dynamics. Depending on the aims of identifi¬ 
cation, the model then could be accepted even when (D.77) is violated, because the 
errors are in frequency range which is out of interest. The MATLAB function res id 
may also estimate a high-order FIR model between residual and inputs: 

e(k) = 9 T (p(k), <p(k ) = [u(k - 1), u(k -2u(k- ri)f. (D.79) 

The frequency response plot of (D.79) along with 99% confidence region is shown. 
The 99% confidence region marks statistically insignificant response. A response 
falling inside the confidence region in the frequency range of interest indicates a 
reliable model. 

Generally, the good model should pass both the whiteness and the independence 
tests except in the following cases: For output-error (OE) models, the modeling focus 
is on dynamics model G(q~ l , 0) and not on the disturbance model H(q~ l ,9). Then, 
it is significant to have independence of residuals and input and we should pay less 
attention to the results of the whiteness of residuals; correlation between residuals and 
input for negative lags is not necessarily an indication of an inaccurate model. When 
current residuals at sample k affect future input values, there might be feedback in 
identified system. In the case of feedback, we should concentrate on the positive lags 
in the independence test. 

D.2 Identification of linear gray-box model 

The gray-box approach is appropriate when we can derive model structure from phys¬ 
ical laws but do not know the values of model parameters and noise model. The main 
advantage of gray-box models in comparison to black-box ones is that the model 
structure reveals physical relations between variables and model parameters have 
physical means. After obtaining model structure, we estimate noise model and phys¬ 
ical parameters by identification procedure using input-output dataset. Most often, 
by gray-box approach, continuous-time models are evaluated because most laws of 
physics are expressed in continuous time. 

Examples for black-box and gray-box identifications are given in Chapter 2. 

D.3 Notes and references 

The identification of linear system models is considered in many books, among them 
Isermann and Miinchhof [208], Landau and Zito [4], Ljung [48], Overschee and De 
Moor [206], Verhaegen and Verdult [207], The methods, presented in Ljung [48], are 
implemented in the System Identification Toolbox of MATLAB, see [173], 





Appendix E 

Interfacing IMU with target microcontroller 


Analog devices MEMS IMU ADIS16405 integrates three gyroscopes and three 
accelerometers orthogonally oriented and also include three magnetometers. A func¬ 
tional diagram of the ADIS16405 IMU is presented in Figure E.l. 

Measurement process is controlled by finite state machines (digital control mod¬ 
ule in Figure E.l). Measurement results and sensor configuration are located at 
dedicated memory and can be accessed from external devices with SPI port. SPI 
stands for Serial Peripheral Interface (synchronous duplex master-slave serial com¬ 
munication). Therefore, angular velocity and acceleration data values are recorded at 
corresponding memory addresses and will be read by SPI. Interconnection between 


AUXADC AUX DAC 



Figure E.l ADIS16405functional diagram 
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Figure E.2 Interconnection between ADIS16405 and TMS320F28335 



Figure E.3 Communications timings for ADIS16405 SPI 


microcontroller and IMU with SPI is presented in Figure E.2. Detailed technical 
information about ADIS16405 is available in [58], 


E.l Driving SPI communication 

SPI communication is composed of four logical lines. Typical transients are illustrated 
on Figure E.3. Low logical level of the signal CS (Chip select) enables data transfer 
from the device. When there are several slave devices to a single SPI master, then 
each slave is on a separate CS. SCLK signal is a clock signal generated by the master 
device ( TMS320F28335 in our case). SIMO (slave in master out) is output for the 
master and input for the slave devices and SOMI (slave out master in) is output for 
the slave and input for the master device. 

DOUT signal on Figure E.3 carries a single 16-b message sent from the sensor to 
microcontroller (MSB, DB14,..., DB1, LSB) where MSB stands for Most Signifi¬ 
cant Bit. The first bit is valid after interval t cs , and every next bit is valid after toAv 
referenced to falling edge of the clocking signal. To read a single bit of information, 
one has to store the level of DOUT line within limited time frame, while the data is 
valid. In opposite case with probability p > 0.5, there will be read erroneous infor¬ 
mation. On Figure E.3, validity time frame for a single bit is defined by parameters 
tiuv and t cs . 

The reader can observe analogical situation for the line DI in Figure E.2. It is used 
by master device to send data to the slave and the first bit signifies the type of operation 
(read or write), second bit is always zero. There is a requirement data to be set on 
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Listing E. 1 Initialization of microcontroller SPI port 


6 

7 

8 


10 

11 

12 


14 

15 

16 


SpiaRegs. SPICCR.bit. SPISWRESET = 0; //SPI Reset 
SpiaRegs.SPICCR.bit.SPICHAR = 15; // Character length control 
SpiaRegs.SPICCR.bit.SPILBK = 0; // Configure SPI for normal mode 

//1(0) = Data is output on falling ( rising) edge and input on rising (falling ) edge. 
SpiaRegs.SPICCR.bit.CLKPOLARITY = 1; 

SpiaRegs.SPICTL.bit.TALK = 1; // Transmit enable, bill, 

SpiaRegs.SPICTL.bit.MASTER_SLAVE = YJ/SP1 configured as a master. 

// I = Data is output one half—cycle before the first rising /falling edge 
SpiaRegs.SPICTL.bit.CLK.PHASE = 0; 

SpiaRegs.SPIPRI.bit .FREE = 1; //Free run, continue SPI operation regardless of suspend 

SpiaRegs.SPIBRR = 40; //Baud rate, bit 

SpiaRegs.SPIFFTX.bit.SPIFFENA =1; // SPIJi FIFO mode 

SpiaRegs.SPIFFCT.all= 20; // FIFO transmit delay 

SpiaRegs.SPICCR.bit.SPISWRESET = 1;//Enable SPI 


a line for time tosu before the rising edge of the clock signal and to stay valid on 
the line for time t DHD after this edge. Obtained timing information concerning SPI 
sensor port is necessary for programing SPI communication module of the microcon¬ 
troller. The table attached to Figure E.3 shows some parameter’s values taken from 
ADIS16405 datasheet document [58]. Microcontroller SPI is set up with the program 
from Listing E.l. 

Peripheral devices of C28x microcontrollers are programed with the help of read 
or write operations executed on specialized addresses. Peripheral device registers 
form a separate address space. Each registers controls some aspect of device function. 
Each peripheral devices user guide can be found in a separate document—[209] for 
SPI [210] for SC, [211] for ADC and so on. In the file DSP2833x_Device.h, there 
is defined structure SpiaRegs of type struct which names control registers and 
bitfields [212], This structure is mapped to peripheral address space during linking 
stage of code generation process. 

ADIS16405 device starts its inertial measurements right after power is supplied. 
Sample time for data acquisition can be tuned. Its default value is T s = 0.0012 s. 
At the end of current sample interval, measured data are stored into sensor memory. 
Listing E.2 defines reading sensor data over SPI. This function can be invoked from 
timer interrupt which occurs periodically or can be invoked when the sensor triggers 
an interrupt. 

Write operation to SPITXBUF field of SpiaRegs structure fills input SPI 
queue of the microcontroller [209]. The code above writes addresses of the sensor reg¬ 
isters which contain inertial measurements. While SPI input queue is not empty, SPI 
module shifts queued data over output line complying to timing setup. Concurrently 
to data sending the microcontroller receives messages from SPImiso line. Received 
messages are stored in SPIFFRX queue. This queue should be empty in initial state 
for correct interpretation of the received messages. Sensor measurements are stored 
as 12 b word [58] which requires application of the 0x3 FFF mask on the received data. 
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Listing E.2 Reading sensor memory over SPI 


10 

11 

12 

13 

14 


17 

18 
19 

21 

22 

24 

25 


E.2 Design of Simulink® interface block 

In simulation mode, the inertial sensor block is only a placeholder (Figure E.4). It has 
defined output ports with appropriate types to allow integration of the sensor data with 
the rest of the model. The block is introduced as S-function ADIS_Driver which is 
kind of C program compiled as a MEX file [9]. S-function defines only initialization 
routine about setup of data type and port configuration and size (Listing E.3). 

There is defined single vector output port with seven components which are 16-b 
unsigned numbers. Another function defines the block sample time as inherited. The 
S-function is compiled with command mex ADIS_Driver. c, which generates 
the ADIS_Driver. *mex* file. The interface between Simulink generated C code 
with sensor SPI driving code there is defined by a TLC file (Listing E.4). 

TLC syntax is documented in [213]. ADIS_Driver TLC file defines following 
model functions: 

• BlockTypeSetup —includes adis_lib. h which declares low level sensor 
driving functions and variables; 

• Start—triggers initialization procedure of the microcontroller SPI device; 

• Outputs—invoked once in every sample interval of model execution. The 
MeasureO function is called and the received data from the sensor stored in the 
Data_Host structure are assigned to the block outputs. 


#defme SUPPLY _OUT 0x0200 
#define XGYRCLOUT 0x0400 

ttdefine ZACCL.OUT OxOEOO 
#define STATUS-REG 0x3C00 

void MeasureO { 

unsigned short buf 1; int i ; 

while (SpiaRegs.SPIFFRX.bit.RXFFST > 0) bufl = ~SpiaRegs.SPIRXBUF; 

SpiaRegs.SPITXBUF = SUPPLY_OUT; SpiaRegs.SPITXBUF = XGYRO_OUT; 
SpiaRegs.SPITXBUF = YGYRO OUT; SpiaRegs.SPITXBUF = ZGYRO OUT; 
SpiaRegs.SPITXBUF = XACCL_OUT; SpiaRegs.SPITXBUF = YACCL.OUT; 
SpiaRegs.SPITXBUF = ZACCL_OUT; SpiaRegs.SPITXBUF = STATUS_REG; 

while (SpiaRegs.SPIFFRX.bit.RXFFST < 7);//Waif to read. Flush the TX fifo . 
bufl = SpiaRegs.SPIRXBUF; //Don’t care word 
for (i=0;i<7;i++) { 

bufl = (SpiaRegs.SPIRXBUF) & 0x3FFF; //Read and filter next word 
Data_Host[i] =bufl; //Put in packet for the host (Simulink model) 

} 
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Figure E.4 Interface blockfor ADIS IMU in Simulink 
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Listing E. 3 S-function definition of the IMU block 


6 

7 

8 
9 

10 
11 
12 
13 

15 

16 
17 


19 

20 


23 

24 


#define S_FUNCTION_NAME ADIS_Driver 
#define S FUNCTION LEVBL 2 

#include ’’simstruc.h” 

static void mdllnitializeSizes (SimStruct *S) 

{ 

ssSetNumContStates(S, 0); 
ssSetNumDiscStates(S, 0); 

if (! ssSetNumOutputPorts(S, 1)) return; // One output port -port 0 
ssSetOutputPortWidth(S, 0, 7); // Dimension of the signal on port 0 

ssSctOutputPortDataTypcfS, 0, SS_UINT16J;/7 Type of the signal at port 0 

ssSetNumSampleTimes(S, 1); 

ssSetNumRWork(S, 0); ssSetNumIWork(S, 0); ssSetNumPWork(S, 0); 
ssSetNumModes(S, 0); ssSetNumNonsampledZCs(S, 0); 


static void mdllmtializeSampleTnnes (SimStruct S) 

ssSetSampleTime(S, 0, INHERITED_SAMPLE-TIME); 
ssSetOffsetTime (S, 0, 0.0); 


Listing E.4 TLC interface between Simulink code and Driver code 


10 
11 
12 

13 

14 

15 


17 

18 

19 

20 
21 
22 


% implements ADIS-Driver ”C” 

%function BlockTypeSetup(block, system) void 
%<LibAddToCommonIncludes(”adisJib.h”)> 


%function Start (block,system) Output 
init_board_spi_port 0; 

%endfunction 

%function Outputs(block,system) Output 

/* %<Type> Block: %<Name> (\%<ParamSettings.FunctionName>) */ 

{ 

Measure (); 

%assignyl = LibBlockOutputSignal(0,””,””,0) 

%<yl> = Data_Host[0]; 

%assigny2 = LibBlockOutputSignal(0,””,””,l) 

%assigny7 = LibBlockOutputSignal(0,6) 

%<y7> = Data Host[6]; 

} 

%endfuncbon 
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Listing E. 5 ADIS16405 generated code 


/* Model step function */ 

void DSP_Embedded_LQRC2_kalman_psi_step(void) 

{ 

/* S-Function Block: <S1>/ADIS16405AMLZ (ADIS-Driver) */ 

{ 

MeasureO; 

DSP_Embedded_LQRC2_kaIman_psi_B.ADIS16405AMLZ[0] = Data_Host[0]; 
DSP_Embedded_LQRC2_kalman_psi_B .ADIS 16405AMLZ[ 1] = Data_Host[l]; 
DSP_Embedded_LQRC2_kalman_psi_B.ADIS16405AMLZ[2] = Data_Host[2]; 
DSP_Embedded_LQRC2_kalman_psi_B .ADIS 16405AMLZ[3] = Data_Host[3]; 
DSP_Embedded_LQRC2_kalman_psi_B .ADIS 16405AMLZ[4] = DataJiost[4]; 
DSP j3mbedded_LQRC2_kalman_psLB .ADIS 16405AMLZ[5] = DataJJost[5]; 
DSP_Embedded_LQRC2_kalman_psi_B .ADIS 16405AMLZ[6] = DataJiost[6]; 

} 


Listing E.5 shows the result from code generation about the sensor which was 
governed by TLC file from Listing E.2. One can see that assigned TLC placeholders 
had got their actual values. For example DSP. . .B.ADIS16405AMLZ [1] replaces 
%<y2> placeholder. 
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Appendix F 

Measuring angular velocity with hall encoder 


The rotational Hall encoder converts the angular velocity to electrical signal. Hall 
elements are semiconductor devices which change its conductivity as a function of 
applied magnetic field. A magnetic disk is coupled to the shaft of an electric motor. 
Along the disk boundary, there are evenly distributed magnetic pole pairs (N or S). 
Close to the magnetic disk, there are mounted both Hall elements which generate 
a logical signal reflecting current polarity (N or S) generating two shifted square 
pulse waveforms (Figure F. 1). Their frequency (2/7’ imp ) is proportional to the angular 
velocity and phase shift x depends on the direction of rotation. Figure F.2 shows 
the interconnection between rotational encoder and microcontroller TMS320F28335. 
The angular velocity is calculated as 



(F.l) 


where s e {0,1} is a logical signal for rotation direction, T imp is the pulse width in 
seconds, n = a> out /w in is the gear ratio, and R is the number of pole pairs of the 
magnetic disk (defining angular resolution). 



Figure F.l Constant angular velocity encoder signals. H\(t ) = H 2 (t + x). 
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TMS320F28335 


Figure F.2 Experimental setting for measuring angular velocity with Hall encoder 
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The signal s is generated from external logic. The pulse train H\ is clock signal 
for a D trigger and If drives the corresponding D input. 

s(t ) = D(t) A (CLK(t) A CLK(f - 5)) (F.2) 

ft) = Hft ) A (H (0 aH ft- 8 )) = H\ (t - t) A (Hi (0 AH ft- 8 )) (F.3) 

The delay 8 is much smaller than phase difference r. The sign of r depends on 
direction of rotation. The signal s feeds the general purpose input output (GPIO) port 
of the microcontroller. 

The duration 7] mp can be precisely measured with enhanced Capture (eCAP) 
module of the C28x microcontroller. The eCAP detects series of events in a logical 
signal and measures the time between them. 

Timp = floor((f 2 — ti)/T c ik)T c ik = N c ikT c t k , 

Hfh <t<t 2 )= 1, Hff - 8) = 0, H 2 (t 2 + 8) = 0, (F.4) 

where T d k is the CPU clock signal period (T c i k = 1/150 x 10 6 ). Some other important 
parameters are—64 pole pairs for the encoder and 29:1 ratio for the gear box. 

A simplified diagram of eCAP component from [214] is presented in Figure F.4. 
The input signal goes to edge detectors for registering the events. Event qualifier 
block is a 2-b counter which increases on each edge detected. When a new event is 
detected, then the value of 32-b dedicated counter is written to a corresponding event 
register. This 32-b counter is reset when detect a rising edge of the monitored signal. 
Timing of eCAP component is presented in Figure F.5. 

Therefore, the Event qualifier bock restarts the counter when rising edge is 
detected from the encoder and writes the counter value in the register when falling 
edge is detected. In this way, the information about impulse duration goes into the 



Figure F.3 Direction detection based on H x and H 2 
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Figure F.4 General structure of the eCAP component 



Figure F.5 Timing of eCAP event capture 
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Figure F.6 Simulink ® model for code generation 


microcontroller. After calculation with (F.4) and (F.l), one can reach the value of 
angular velocity. 

The angular velocity is calculated by Driver program according to (F. 1) which has 
T ]mp and s as input parameters. Simulink Data Flow model of the program is presented 
on Figure F.6. There are eCAP and GPIO DI blocks from the C2000 Simulink library. 

All measurements &> = &) + A (U carry some numerical error A,„. To analyze these 
measurement errors, we build a simulation model of the experimental setup shown 
in Figure F.7. 
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Figure F.7 Simulink model for angular velocity measurement 


Figure F.8 Model of magnetic disk and Hall elements 


The shaft rotation signal goes to the model of rotational encoder containing 
magnetic disk and Hall elements models (Figure F.8). As a result, H x and H 2 wave¬ 
forms are modeled (A and B in the figure). They go to the cycle-accurate model 
of the C28x microcontroller (Figure F.9). It models eCAP hardware component and 
program execution. 

Rotational encoder model (Figure F.8) has two data flow channels. The absolute 
value of the shaft angle equals the angle of magnetic disk rotation in [0 360] deg. 

«disk = of shaft mod 360 (F.5) 

The magnetic disk has 64 pole pairs hence each pair covers 360/64 = 5.625 deg. 
Next block calculates the disk angle in the limits of one pole pair. 

“pole = “disk mod 5.625 (F.6) 

The N and S poles of the pair cover 5.625/2 = 2.8125 deg, respectively. The Hall 
element generates a logical signal level depending on pole type. So its mathematical 
descriptions is 


H(f) = 


1, Qfpoie < 2.8125 
0, “pole >2.8125 


(F.7) 


Second encoder channel is modeled accounting for a time shift in its input signal 
caused by spatial shift of the Hall elements. 













Figure F.9 Microcontroller model 
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Simulation of encoder data-processing algorithm 



Figure F.10 Simulation of rotation encoder data acquisition by the microcontroller 


Microcontroller model of encoder signal processing (Figure F.9) has the following 
subsystems: 


Model of the direction detector from Figure F.3. The trigger is modeled as a 
Triggered Subsystem block which is left empty (direct throughput). So the output 
becomes equal to the input on the rising edge of the trigger port. 


m = 


{ u(f), T(t -8) A T(t) 

l y(t — 1), Tit - 8) v T(t) 


T(t ) = u(t- T) 


y(t) = 


1, r < 0 
0, r >0 


(F.8) 


(F.9) 


• A model of eCAP module organized around integrator with input 1 for modeling 
of the 32-b counter. The integrator is restarted after delay S of the encoder signal 
rising edge. Same rising edge causes write of the integrator value into the register 
before its restart. The register is modeled as Triggered Subsystem. 

• A model for program calculating the angular velocity (Figure F.6). 


Figure F. 10 shows a comparison of angular velocity measurement of the encoder 
model with the original sinusoidal signal (0.5 Hz). 
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Design of Embedded Robust Control 
Systems Using MATLAB® / Simulink® 


Robust control theory allows for changes in a system whilst maintaining stability and 
performance. Applications of this technique are very important for dependable embedded 
systems, making technologies such as drones and other autonomous systems with 
sophisticated embedded controllers and systems relatively common-place. 

The aim of this book is to present the theoretical and practical aspects of embedded robust 
control design and implementation with the aid of MATLAB® and SIMULINK®. It covers 
methods suitable for practical implementations, combining knowledge from control system 
design and computer engineering to describe the entire design cycle. 

Three extended case studies are developed in depth: embedded control of a tank physical 
model; robust control of a miniature helicopter; and robust control of two-wheeled robots. 
These are taken from the area of motion control but the book may be also used by 
designers in other areas. Some knowledge of Linear Control Theory is assumed and 
knowledge of C programming is desirable but to make the book accessible to engineers 
new to the field and to students, the authors avoid complicated mathematical proofs and 
overwhelming computer architecture technical details. All programs used in the examples 
and case studies are freely downloadable to help with the assimilation of the book contents. 
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